-- Logs begin at Fri 2022-09-09 20:14:53 UTC, end at Fri 2022-09-09 21:31:57 UTC. -- Sep 09 20:56:23.251714 dv-cinder-831247-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 20:56:23.260255 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 20:56:23 2022] *** Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: nodename: dv-cinder-831247-28-iscsi Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: machine: x86_64 Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: clock source: unix Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: pcre jit disabled Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: detected number of CPU cores: 4 Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: current working directory: / Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: detected binary path: /usr/bin/uwsgi-core Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: your processes number limit is 47680 Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: your memory page size is 4096 bytes Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: detected max file descriptor number: 2048 Sep 09 20:56:23.262256 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: lock engine: pthread robust mutexes Sep 09 20:56:23.263702 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: thunder lock: enabled Sep 09 20:56:23.263702 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 20:56:23.263702 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 20:56:23.301554 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: Python main interpreter initialized at 0x55abd2d119c0 Sep 09 20:56:23.301554 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: python threads support enabled Sep 09 20:56:23.301554 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: your server socket listen backlog is limited to 100 connections Sep 09 20:56:23.301554 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: your mercy for graceful operations on workers is 90 seconds Sep 09 20:56:23.301870 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 20:56:23.301945 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: *** Operational MODE: preforking *** Sep 09 20:56:23.302192 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: *** uWSGI is running in multiple interpreter mode *** Sep 09 20:56:23.302192 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: spawned uWSGI master process (pid: 106082) Sep 09 20:56:23.302371 dv-cinder-831247-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 20:56:23.304634 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: spawned uWSGI worker 1 (pid: 106083, cores: 1) Sep 09 20:56:23.304634 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: spawned uWSGI worker 2 (pid: 106084, cores: 1) Sep 09 20:56:23.304634 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 20:56:23.958159 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 20:56:23.976585 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 20:56:25.040817 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:56:25.040817 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: from cryptography.utils import int_from_bytes Sep 09 20:56:25.041330 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:56:25.041330 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: from cryptography.utils import int_from_bytes Sep 09 20:56:25.047210 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:56:25.047210 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: from cryptography.utils import int_from_bytes Sep 09 20:56:25.047646 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:56:25.047646 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: from cryptography.utils import int_from_bytes Sep 09 20:56:27.530242 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:56:27.530826 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:56:27.531016 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:56:27.531370 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:56:27.531621 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:56:27.531711 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:56:27.532097 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:56:27.532202 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.532331 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.532481 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:56:27.532643 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.532844 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:56:27.532949 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.533105 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:56:27.533276 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.533489 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.533593 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.533809 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.533913 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.534128 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.534216 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.534445 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.534539 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.534698 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.534791 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535004 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535100 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535318 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-28-iscsi {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535405 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535629 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535715 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.535927 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536019 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536248 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536342 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536555 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536640 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536849 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.536936 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-28-iscsi {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.537162 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.537255 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.537458 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.537549 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.537777 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.537944 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539129 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539129 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539300 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539300 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539426 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539496 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539574 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539640 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539704 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539786 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539859 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.539924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.540034 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.540157 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.540377 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.540593 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.540783 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.540980 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.541157 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.541355 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.541542 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.541751 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-28-iscsi {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.541929 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.542081 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.542258 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.542434 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.542615 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.542839 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.543023 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.543206 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.543401 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-28-iscsi {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.543607 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.543758 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.543942 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.544816 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.544959 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545086 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545244 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545381 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545506 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545630 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545764 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.545922 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546048 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546172 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546304 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546569 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546694 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546829 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.546829 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547182 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547350 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547484 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547609 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547733 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547865 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.547996 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548156 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548290 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548415 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548538 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548661 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548785 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.548917 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549049 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549174 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549296 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549418 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549554 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549687 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.549812 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550000 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550137 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550261 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550412 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550536 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550660 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550782 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.550913 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551197 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551322 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551446 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551577 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551700 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551832 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.551957 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552101 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552226 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552361 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552495 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552621 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552751 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552874 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.552998 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553120 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553251 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553382 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553525 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553684 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.553998 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.554135 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.554387 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.554519 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.554641 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.554821 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.554948 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.555148 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.555275 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.555453 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.555579 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.555771 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.555910 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.556146 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.556288 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.556442 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.556568 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.556750 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.556888 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557048 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557268 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557395 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557517 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557638 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557773 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.557957 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558091 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558255 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558381 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558502 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558633 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558780 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.558906 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.559077 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.559210 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.559385 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.559520 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.559684 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.559824 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.560036 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.560740 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.560911 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.561039 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.561168 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.561300 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.561433 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.561586 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.561876 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.562008 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.562131 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.562262 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.563389 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.563542 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.565135 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.565288 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.565421 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.565548 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.565672 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.565810 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.567282 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.567501 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.567640 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.567767 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.567901 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568041 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568187 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568311 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568501 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568633 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568757 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.568899 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569031 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569156 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569287 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569410 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569533 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569664 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.569910 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570031 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570153 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570274 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570404 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570528 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570650 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570781 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.570916 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571039 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571170 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571293 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571415 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571536 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571657 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571778 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.571980 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.572124 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.572261 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.572385 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.572564 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.572781 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.572994 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573143 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573143 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573475 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573598 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573719 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573854 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.573979 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574100 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574221 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574480 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574602 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574724 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574851 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.574973 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575103 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575240 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575373 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575496 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575618 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575739 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575859 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.575990 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576166 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576300 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576423 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576553 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576676 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576807 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.576930 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.577062 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.577186 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.577308 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.577438 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.577644 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.577779 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.577903 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.578036 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.578157 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.578287 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.578413 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.578535 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.578665 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.578802 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.578926 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:56:27.579058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579182 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579304 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579434 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579558 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579693 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579817 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.579939 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580061 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580061 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580325 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580461 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580585 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580707 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580828 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.580953 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581077 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581212 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581338 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581459 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581601 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581734 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581858 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.581988 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582121 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582246 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582377 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582507 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582632 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582767 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.582891 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583013 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583136 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583258 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583381 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583512 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583644 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583776 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.583899 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584022 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584175 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584301 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584433 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584557 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584687 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584811 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.584947 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585078 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585203 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585326 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585461 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585594 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585727 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585852 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.585982 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586106 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586228 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586362 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586484 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586608 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586739 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586863 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.586986 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587107 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587243 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587367 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587496 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587639 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587828 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.587963 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588117 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588237 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588359 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588492 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588757 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.588887 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589010 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589131 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589252 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589372 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589502 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589624 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589757 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.589880 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590008 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590132 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590262 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590392 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590514 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590636 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590757 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.590954 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591078 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591231 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591358 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591479 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591608 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591739 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591863 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.591999 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.592140 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.592264 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.592384 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.592648 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.592783 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.592906 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.593028 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.593149 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.594191 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.594353 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.594482 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.595968 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596179 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596315 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596458 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596585 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596831 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.596953 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.597885 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598105 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598239 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598364 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598488 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598611 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598734 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.598939 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599066 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599200 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599325 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599449 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599571 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599704 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599836 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.599961 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600106 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600247 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600386 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600519 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600651 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600776 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.600899 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601021 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601149 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601277 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601407 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601540 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601673 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601796 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.601928 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602052 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602183 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602309 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602432 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602580 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602797 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.602997 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.603162 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.603377 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.603507 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.603647 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.603790 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.603905 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604042 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604232 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604358 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604495 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604621 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604744 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.604866 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605001 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605126 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605262 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605387 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605510 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605682 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605815 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605947 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.605947 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.606190 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.606321 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.606446 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.606579 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.606712 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.607339 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.607463 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.607586 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.607709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.607829 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.607970 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608125 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608320 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608446 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608585 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608710 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608848 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.608973 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609105 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609229 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609352 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609475 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609611 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609736 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609867 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.609990 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610120 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610257 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610382 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610518 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610645 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610767 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.610890 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611020 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611145 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611267 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611390 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611512 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611635 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611766 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.611898 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612022 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612179 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612305 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612427 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612559 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612684 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612807 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.612930 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613051 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613174 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613304 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613428 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613551 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613680 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613804 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.613935 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614069 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614193 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614315 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614592 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614730 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614856 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.614987 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615118 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615249 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615369 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615574 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615687 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615811 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.615942 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616087 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616213 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616213 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616466 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616588 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616588 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616818 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.616951 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617084 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617209 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617368 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617533 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617658 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617795 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.617918 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618041 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618171 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618317 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618513 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618650 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618776 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.618906 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.619032 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.619305 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.619434 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.619636 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.619770 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.619895 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620017 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620229 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620356 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620489 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620621 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620745 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620868 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.620998 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621136 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621262 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621388 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621520 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621644 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621766 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.621897 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.622021 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.622145 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.622275 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.622485 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623096 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623229 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623354 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623477 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623600 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623722 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623846 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.623978 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624112 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624250 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624378 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624501 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624632 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624757 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.624880 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625060 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625188 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625373 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625508 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625678 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625805 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.625978 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.626121 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.626287 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.626423 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.626588 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.626715 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.626885 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627013 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627183 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627321 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627481 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627608 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627783 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.627916 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.628127 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.628260 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.628416 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.628591 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.628718 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.628854 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629029 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629157 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629336 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629462 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629642 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629753 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.629944 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630041 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630246 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630345 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630560 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630657 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630862 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.630957 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.631163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.631268 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.631463 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.631560 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.631765 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.631852 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.632077 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.632167 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.632393 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.632498 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.632705 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.632801 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633007 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633094 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633310 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633412 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633611 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633699 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.633907 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.634002 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.634213 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.634376 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.634510 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.634656 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.634841 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.635077 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.635218 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.635403 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.635539 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.635712 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.635845 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636025 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636212 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636350 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636483 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636664 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636809 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.636973 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.637108 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.637282 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.637419 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.637590 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.637728 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.637891 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.638081 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.638241 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.638378 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.638514 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.638646 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.638790 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639075 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639222 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639367 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639580 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639720 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639854 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.639988 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.640202 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.640338 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.640473 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.640615 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.640758 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.640892 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641032 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641175 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641309 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641443 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641613 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641753 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.641903 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642052 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642191 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642327 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642471 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642618 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.642974 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643118 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643257 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643394 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643538 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643685 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643834 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.643972 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644125 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644407 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644557 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644695 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644832 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.644968 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.645116 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.645264 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.645403 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.645574 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.645737 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.645876 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646013 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646158 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646297 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646459 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646604 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646741 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.646878 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647027 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647174 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647312 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647458 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647606 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647743 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.647889 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648027 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648220 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648367 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648516 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648667 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648812 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.648963 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.649110 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.649254 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.649409 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.649656 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.649819 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.649957 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650101 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650246 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650385 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650532 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650671 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650817 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.650964 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.651103 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.651239 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.651394 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.651616 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.651773 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.651912 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652049 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652228 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652507 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652645 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652781 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.652927 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653073 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653219 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653367 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653504 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653670 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653816 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.653963 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654102 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654239 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654377 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654559 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654699 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654850 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.654997 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.655144 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.655293 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.655429 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.655579 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.655718 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.655856 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656000 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656164 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656303 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656452 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656591 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656737 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.656884 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657022 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657169 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657321 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657460 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657605 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657743 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.657888 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658026 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658173 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658311 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658455 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658606 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658744 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.658900 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659039 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659176 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659320 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659458 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659594 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659757 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.659966 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660129 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660273 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660412 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660560 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660708 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660855 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.660993 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661130 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661268 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661405 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661555 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661693 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661830 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.661974 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662113 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662263 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662410 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662548 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662697 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662841 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.662980 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.663131 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.663270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.663435 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.663580 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.663718 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.663855 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.664033 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.664256 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.664403 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.664542 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.664699 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.664846 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665009 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665157 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665296 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665431 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665567 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665716 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665854 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.665992 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666128 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666267 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666403 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666558 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666695 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666832 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.666969 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.667106 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.667279 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.667434 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.667572 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.667710 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.667873 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668025 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668212 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668333 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668531 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668641 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668846 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.668945 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.669145 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.669252 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.669971 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670060 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670272 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670376 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670574 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670664 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670877 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.670972 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.671182 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.671269 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.671481 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.671569 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.671798 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.671885 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.672106 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.672204 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.672415 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.672506 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.672720 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.672806 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673020 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673115 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673325 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673421 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673630 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673718 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.673929 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674025 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674235 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674320 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674536 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674637 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674838 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.674947 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.675139 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.675225 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.675435 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.675521 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.675739 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.675835 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676037 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676150 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676364 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676495 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676672 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676804 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.676981 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.677109 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.677286 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.677409 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.677595 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.677713 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.677902 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678019 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678203 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678326 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678522 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678632 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678830 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.678939 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.679133 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.679323 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.679426 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.679627 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.679714 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.679931 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.680021 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.680260 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.680364 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.680559 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.680740 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.680856 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681048 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681143 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681355 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681465 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681659 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681768 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.681967 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682063 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682274 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682370 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682586 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682673 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682895 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.682992 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.683196 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.683285 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.683606 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.683693 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.683909 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.684003 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.684238 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.684327 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.684547 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.684637 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.684853 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.685488 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.685692 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.685834 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686001 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686138 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686322 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686481 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686629 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686767 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.686905 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687042 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687204 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687351 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687497 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687636 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687786 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.687945 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.688117 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.688276 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.688517 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.688695 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.688836 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.688996 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.689147 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.689297 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.689444 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.689584 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.689723 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.689867 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.690005 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.690151 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.690376 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.690523 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.690685 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.690832 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.691001 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.691165 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.691306 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.691698 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.691837 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.691973 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.692168 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.692322 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.692485 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.692629 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.692774 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.692913 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693077 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693232 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693388 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693529 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693666 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693804 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.693954 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694095 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694232 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694370 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694538 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694692 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694839 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.694978 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.695115 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.695302 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.695448 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.695623 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.695778 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.695925 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.696063 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.696263 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.696408 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.696587 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.696745 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.696892 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697031 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697169 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697316 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697464 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697603 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697768 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.697916 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698055 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698193 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698376 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698530 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698669 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698807 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.698944 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699093 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699240 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699379 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699560 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699704 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699852 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.699989 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.700171 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.700316 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.700559 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.700716 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.700858 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701004 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701155 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701301 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701440 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701578 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701725 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.701873 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702013 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702150 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702288 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702426 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702614 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702769 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.702910 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703064 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703211 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703350 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703488 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703638 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703777 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.703914 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704092 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704243 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704393 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704533 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704670 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704808 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.704963 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705103 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705250 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705389 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705526 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705663 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705800 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.705969 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.706137 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.706278 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.706422 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.706601 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.706765 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.706914 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707052 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707213 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707359 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707536 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707682 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707833 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.707971 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.708141 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.708285 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.708424 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.708561 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.708727 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.708866 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709004 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709142 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709306 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709452 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709642 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709783 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.709922 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.710059 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.710203 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.710351 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.710490 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.710725 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.710877 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711016 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711154 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711299 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711447 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711586 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711723 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.711867 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712014 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712373 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712511 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712667 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712806 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.712944 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.713154 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.713309 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.713486 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.713639 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.713778 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.713922 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.714097 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.714251 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.714391 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.714571 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.714717 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.714864 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715003 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715140 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715285 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715424 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715591 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715746 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.715886 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716024 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716241 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716342 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716553 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716725 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716869 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.716960 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.717181 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.717272 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.717496 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.717589 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.717810 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718015 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718106 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718345 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718442 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718659 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718757 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.718975 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.719077 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.719287 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.719386 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.719600 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.719688 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.719911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720008 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720249 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720341 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720562 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720649 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720866 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.720953 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.721171 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.721260 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.721480 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.721581 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.721796 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.721884 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.722103 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.722193 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.722410 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.722511 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.722719 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.722822 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723026 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723133 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723336 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723426 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723650 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723811 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.723963 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.724051 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.724301 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.724402 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.724611 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.724701 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.724919 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.725006 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.725263 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.725428 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.725535 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.725737 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.725826 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.726064 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.726161 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.726383 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.726485 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.726698 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.726788 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727009 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727097 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727316 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727404 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727628 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727723 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.727927 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728014 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728255 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728346 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728562 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728658 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728868 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.728958 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.729167 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.729300 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.729485 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.729582 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.729789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.729879 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.730089 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.730301 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.730404 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.730617 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.730706 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.730946 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.731210 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.731299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.731557 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.731645 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.732400 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.732573 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.732716 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.732803 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733033 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733129 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733337 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733433 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733637 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733724 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.733945 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734031 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734245 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734340 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734543 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734644 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734855 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.734943 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.735161 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.735249 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.735459 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.735547 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.735758 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.735845 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.736062 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.736164 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.736388 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.736614 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.736709 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.736958 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737065 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737263 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737351 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737582 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737668 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737880 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.737968 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.738180 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.738266 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.738477 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.738564 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.738780 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.738869 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739078 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739221 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739380 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739491 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739680 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739777 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.739978 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740103 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740306 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740384 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740603 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740682 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740907 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.740995 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.741205 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.741302 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.741508 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.741595 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.741817 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.741904 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.742120 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.742216 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.742434 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.742521 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.742736 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.742827 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743036 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743136 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743333 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743429 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743640 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743727 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.743941 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744098 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744400 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744575 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744663 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744878 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.744967 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.745190 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.745286 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.745494 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.745582 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.745801 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.746028 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.746117 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.746362 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.746451 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.746677 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.746774 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.747004 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.747092 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.747321 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.747978 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.748192 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.748297 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.748498 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.748594 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.748799 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.748886 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.749111 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.749200 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.749434 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.749523 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.749726 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.749815 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750031 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750121 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750337 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750424 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750640 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750774 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.750945 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.751043 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.751252 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.751506 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.751596 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.751837 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.751937 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.752167 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.752262 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.752475 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.752576 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.752780 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.752870 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.753084 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.753173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.753390 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.753478 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.753698 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.753790 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754031 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754117 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754344 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754460 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754655 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754744 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.754961 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755048 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755270 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755366 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755573 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755661 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755877 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.755964 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.756211 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.756321 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.756516 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.756612 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.756827 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.756914 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.757150 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.757256 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.757460 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.757549 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.757762 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.757858 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.758070 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.758382 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.758471 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.758694 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.758782 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759024 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759119 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759339 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759425 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759644 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759739 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.759955 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760050 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760295 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760383 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760601 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760690 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760909 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.760998 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.761215 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.761303 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.761519 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.761607 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.761833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.761922 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.762160 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.762248 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.762472 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.762559 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.762770 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.762905 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.763094 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.763397 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.763492 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.763705 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.763804 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764019 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764127 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764350 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764439 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764650 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764740 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.764950 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765038 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765255 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765344 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765555 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765645 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765854 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.765951 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.766154 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.766243 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.766452 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.766549 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.766758 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.766846 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767056 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767153 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767354 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767442 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767652 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767740 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.767951 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768048 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768276 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768575 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768663 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768879 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.768978 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.769177 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.769273 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.769473 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.769562 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.769772 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.769869 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770069 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770158 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770366 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770454 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770690 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770778 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.770995 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.771085 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.771304 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.771387 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.771613 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.771702 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.771915 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772002 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772244 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772335 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772547 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772637 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772850 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.772984 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.773155 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.773247 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.773459 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.773549 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.773765 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.773878 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.774093 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.774190 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.774399 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.774495 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.774706 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.774794 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775013 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775114 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775314 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775402 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775617 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775706 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.775922 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776019 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776279 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776370 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776598 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776684 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776898 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.776994 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.777216 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.777303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.777524 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.777611 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.777836 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.777926 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.778146 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.778242 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.778453 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.778542 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.779284 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.779376 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.779595 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.779690 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.779902 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.779990 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.780231 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.780366 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.780537 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.780628 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.780841 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.780939 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.781150 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.781242 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.781457 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.781544 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.781762 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.781858 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.782071 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.782168 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.782381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.782470 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.782705 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.782863 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783024 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783112 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783326 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783412 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783646 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783741 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.783959 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.784048 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.784317 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.784418 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.784625 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.784722 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.784932 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785019 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785242 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785330 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785552 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785648 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785859 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.785953 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.786161 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.786258 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.786423 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:56:27.786522 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.786765 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.787082 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.787399 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.787726 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.788049 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.788391 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.788716 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.789042 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.789390 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.789704 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.790043 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.790371 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.790683 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.790995 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.791300 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:56:27.791543 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:56:27.940695 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Registered counter for database nova_api Sep 09 20:56:27.944462 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Registered counter for database nova_api Sep 09 20:56:27.961654 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:27.963909 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:27.968747 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:27.970914 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.025392 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.context [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ceb83d-97f3-4964-9e40-c191a7de62e9(cell1) {{(pid=106084) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 20:56:28.026436 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.context [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ceb83d-97f3-4964-9e40-c191a7de62e9(cell1) {{(pid=106083) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 20:56:28.030100 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:56:28.030623 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:56:28.030847 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:56:28.031320 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:56:28.032112 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:56:28.032820 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:56:28.032914 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:56:28.033257 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:56:28.033620 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 20:56:28.034064 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 20:56:28.035223 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:56:28.036058 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_concurrency.lockutils [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 20:56:28.037234 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Registered counter for database nova_cell0 Sep 09 20:56:28.038059 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Registered counter for database nova_cell0 Sep 09 20:56:28.041206 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Registered counter for database nova_cell1 Sep 09 20:56:28.041998 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Registered counter for database nova_cell1 Sep 09 20:56:28.048823 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:28.051051 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:28.053476 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.054839 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:28.054960 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:28.057353 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.194377 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.196882 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.206160 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO dbcounter [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Registered counter for database nova_cell0 Sep 09 20:56:28.207211 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO dbcounter [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Registered counter for database nova_cell0 Sep 09 20:56:28.215353 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_db.sqlalchemy.engines [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:28.219246 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG oslo_db.sqlalchemy.engines [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:56:28.220724 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writer thread running {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.225000 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writer thread running {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:56:28.628274 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:56:28.635509 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:56:28.675459 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:56:28.682784 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:56:28.976099 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:56:28.982651 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: WARNING keystonemiddleware.auth_token [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:56:28.987969 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abd2d119c0 pid: 106084 (default app) Sep 09 20:56:28.990074 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:56:28.991237 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Sep 09 20:56:28.991648 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Sep 9 20:56:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:56:29.026685 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 20:56:29.033036 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: WARNING keystonemiddleware.auth_token [None req-e4b55e76-4815-4a81-b99e-0c48fb0b4c90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 20:56:29.038376 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55abd2d119c0 pid: 106083 (default app) Sep 09 20:57:53.013597 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:57:53.015303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 Sep 09 20:57:53.016167 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:57:53.033875 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:53.034959 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_cell0:SELECT=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:53.035816 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_cell1:SELECT=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:53.036684 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:53.919814 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-1755dcfb-d1b3-4296-8640-eafdf7ed90d1 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:57:53.956668 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-1755dcfb-d1b3-4296-8640-eafdf7ed90d1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.932972 Sep 09 20:57:53.958554 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Sep 9 20:57:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:57:56.579425 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:57:56.580473 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-f8690082-42d3-4fb7-9e47-1bb9c21a70b5 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 09 20:57:56.581030 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:57:57.050825 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-32934ff9-72b3-43c4-926b-160e3f047068 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:57:57.156799 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-32934ff9-72b3-43c4-926b-160e3f047068 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.569853 Sep 09 20:57:57.157367 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:57:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:57:57.174357 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=3 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.175335 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell1:SELECT=3 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.177450 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell0:SELECT=3 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.178337 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.386806 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-daf626c5-c35f-450c-858f-ba5d53e4379d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:57:57.481281 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-daf626c5-c35f-450c-858f-ba5d53e4379d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.314430 Sep 09 20:57:57.481864 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Sep 9 20:57:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:00.091106 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-32934ff9-72b3-43c4-926b-160e3f047068 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:00.092389 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-32934ff9-72b3-43c4-926b-160e3f047068 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Sep 09 20:58:00.093096 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:00.741100 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-38738ebe-96ff-4161-93bc-b0e4578df337 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "ds512M", "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:00.878672 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-38738ebe-96ff-4161-93bc-b0e4578df337 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777573 Sep 09 20:58:00.879159 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:00.891873 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8aac5768-4e90-4c9c-93f7-0327724ac78a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:01.015831 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8aac5768-4e90-4c9c-93f7-0327724ac78a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127789 Sep 09 20:58:01.016666 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Sep 9 20:58:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:03.635998 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-38738ebe-96ff-4161-93bc-b0e4578df337 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:03.636976 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-38738ebe-96ff-4161-93bc-b0e4578df337 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 09 20:58:03.637426 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:04.050664 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-00c09e2e-051a-4207-97c6-c225939b6b04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:04.145617 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-00c09e2e-051a-4207-97c6-c225939b6b04 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501577 Sep 09 20:58:04.146181 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:58:04.161456 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-c8135d3d-91e3-43b9-8b56-c5d5813c40b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:04.253336 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-c8135d3d-91e3-43b9-8b56-c5d5813c40b0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097420 Sep 09 20:58:04.254007 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Sep 9 20:58:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:06.860715 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-00c09e2e-051a-4207-97c6-c225939b6b04 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:06.862510 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-00c09e2e-051a-4207-97c6-c225939b6b04 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Sep 09 20:58:06.863081 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:07.280555 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-ed4ea345-c156-4ab5-a2da-9d0f0100413e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:07.359475 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-ed4ea345-c156-4ab5-a2da-9d0f0100413e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490272 Sep 09 20:58:07.360289 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:07.373483 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-18972db3-1890-4262-995a-ceaa44eb44c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:07.459633 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-18972db3-1890-4262-995a-ceaa44eb44c8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090529 Sep 09 20:58:07.460405 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Sep 9 20:58:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:10.547121 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-ed4ea345-c156-4ab5-a2da-9d0f0100413e admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:10.548526 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-ed4ea345-c156-4ab5-a2da-9d0f0100413e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Sep 09 20:58:10.549020 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:11.076121 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-29a0b26a-a923-4ed7-be71-664af7fb33fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:11.154639 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-29a0b26a-a923-4ed7-be71-664af7fb33fa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.597400 Sep 09 20:58:11.155246 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:11.168718 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-0b89d1b1-748c-4cd4-8c55-a0cfde051385 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:11.266318 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-0b89d1b1-748c-4cd4-8c55-a0cfde051385 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101603 Sep 09 20:58:11.266948 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Fri Sep 9 20:58:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:14.085122 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-29a0b26a-a923-4ed7-be71-664af7fb33fa admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:14.086140 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-29a0b26a-a923-4ed7-be71-664af7fb33fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 09 20:58:14.086605 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:14.543609 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-e214b5c0-c151-44f2-a584-30edca2e817d admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:14.568354 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-e214b5c0-c151-44f2-a584-30edca2e817d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474714 Sep 09 20:58:14.568895 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Sep 9 20:58:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:17.234780 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-29a0b26a-a923-4ed7-be71-664af7fb33fa admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:17.235831 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-29a0b26a-a923-4ed7-be71-664af7fb33fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 09 20:58:17.236307 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:17.634168 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-bedb8926-41d8-40b4-b4dd-80350ece6e17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:17.710972 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-bedb8926-41d8-40b4-b4dd-80350ece6e17 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468553 Sep 09 20:58:17.711621 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:17.724090 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-c0f75c0a-5a40-4c88-9d37-8353352d9667 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:17.806077 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-c0f75c0a-5a40-4c88-9d37-8353352d9667 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085961 Sep 09 20:58:17.807499 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Sep 9 20:58:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 20:58:20.412246 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-bedb8926-41d8-40b4-b4dd-80350ece6e17 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:20.413405 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-bedb8926-41d8-40b4-b4dd-80350ece6e17 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Sep 09 20:58:20.413893 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:20.827293 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-d3b193e7-ba24-427f-b7ae-436ac2846c00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:20.912332 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-d3b193e7-ba24-427f-b7ae-436ac2846c00 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491759 Sep 09 20:58:20.912879 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:20.925448 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-7110df7f-7e8f-470e-ba74-5fc0f32b1ebf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:21.001885 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-7110df7f-7e8f-470e-ba74-5fc0f32b1ebf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080018 Sep 09 20:58:21.002459 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Sep 9 20:58:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:23.610487 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-d3b193e7-ba24-427f-b7ae-436ac2846c00 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:23.611511 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-d3b193e7-ba24-427f-b7ae-436ac2846c00 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 09 20:58:23.612549 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:24.078137 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-8dd0b302-4a94-486c-9a06-7a015a65f6e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:24.157051 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-8dd0b302-4a94-486c-9a06-7a015a65f6e5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.536803 Sep 09 20:58:24.157779 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:24.170612 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-f3b91d0e-981c-495e-a4ed-2c8399623706 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:24.175752 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:24.294497 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-f3b91d0e-981c-495e-a4ed-2c8399623706 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127989 Sep 09 20:58:24.316097 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Sep 9 20:58:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:26.951060 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-8dd0b302-4a94-486c-9a06-7a015a65f6e5 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:26.952113 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-8dd0b302-4a94-486c-9a06-7a015a65f6e5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 09 20:58:26.952713 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:27.398543 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-e36cb5b6-0943-42d5-9cf3-36804cb5bc89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:27.467573 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-e36cb5b6-0943-42d5-9cf3-36804cb5bc89 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.508899 Sep 09 20:58:27.475082 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:27.480914 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-40e9d2b6-a296-454a-8e63-3836736834fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:27.487481 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:27.563547 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-40e9d2b6-a296-454a-8e63-3836736834fa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087092 Sep 09 20:58:27.564480 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Sep 9 20:58:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:30.173723 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-e36cb5b6-0943-42d5-9cf3-36804cb5bc89 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:30.174813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-e36cb5b6-0943-42d5-9cf3-36804cb5bc89 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 09 20:58:30.175220 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:30.625690 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1f055d33-b167-4b67-82c1-5276c9037cd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:30.696014 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1f055d33-b167-4b67-82c1-5276c9037cd2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.514552 Sep 09 20:58:30.703690 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Fri Sep 9 20:58:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:58:30.710746 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-34a443e9-6e75-42dc-a53a-3207e0ca6fea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:30.795424 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-34a443e9-6e75-42dc-a53a-3207e0ca6fea admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089991 Sep 09 20:58:30.795784 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Fri Sep 9 20:58:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 20:58:48.412353 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1f055d33-b167-4b67-82c1-5276c9037cd2 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:48.413391 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1f055d33-b167-4b67-82c1-5276c9037cd2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 09 20:58:48.413812 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 20:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:48.425051 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:48.807522 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-3e1b241d-d629-4617-b695-131882dc4b9c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:48.825632 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-3e1b241d-d629-4617-b695-131882dc4b9c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405184 Sep 09 20:58:48.826174 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Sep 9 20:58:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:50.127701 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-1f055d33-b167-4b67-82c1-5276c9037cd2 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:50.128746 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-1f055d33-b167-4b67-82c1-5276c9037cd2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 09 20:58:50.129152 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:50.653953 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-63022824-76fa-4bd0-9917-b880b7724843 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:50.659317 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.wsgi [None req-63022824-76fa-4bd0-9917-b880b7724843 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-63022824-76fa-4bd0-9917-b880b7724843 admin admin] Request method failure captured: Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Accept: application/json Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Accept-Encoding: gzip, deflate Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Connection: keep-alive Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Content-Length: 0 Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Host: 10.222.0.48 Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Openstack-Api-Version: compute 2.92 Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Openstack-System-Scope: None Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: User-Agent: python-novaclient Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Auth-Token: gAAAAABjG6kKBmUMmXR3DZHhQOVq0JQtXt-MGXqy5Ht2CniKCJsTyTobUOhH1jmzgMtVZ2zB1x7hX8nuo0HyACkHQ1vWNNOW-_8B4bOBKLBiFJEvHnVd6UFJx0VCMfZomS8NU5TdJFFlkP_9yUw9fOPS2DmD_Zgp7wyh0ma4RYyFjev5eapj2zo Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Domain-Id: None Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Domain-Name: None Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Identity-Status: Confirmed Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Is-Admin-Project: True Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Domain-Id: default Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Domain-Name: Default Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Name: admin Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Role: reader,admin,member Sep 09 20:58:50.662625 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Roles: reader,admin,member Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d43f38801344407291af57c99bc81066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d43f38801344407291af57c99bc81066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant: admin Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant-Name: admin Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User: admin Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Domain-Id: default Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Domain-Name: Default Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Id: 2e3a7a2557844cc78377f788a7c8c3ae Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Name: admin Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: method: > Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: exception: Flavor 42 could not be found. Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: action_args: {'id': '42'} Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:58:50.664270 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:50.665299 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.666696 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-63022824-76fa-4bd0-9917-b880b7724843 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:58:50.668539 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-63022824-76fa-4bd0-9917-b880b7724843 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397779 Sep 09 20:58:50.668539 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Sep 9 20:58:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:50.674569 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-e80c8668-2e1a-4b7e-b655-d0a538204534 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:50.678602 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:50.697626 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-e80c8668-2e1a-4b7e-b655-d0a538204534 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026593 Sep 09 20:58:50.698175 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Sep 9 20:58:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:50.708992 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-ef03d17b-af61-48f1-9fa6-19f5b3ad00d7 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:50.732166 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-ef03d17b-af61-48f1-9fa6-19f5b3ad00d7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027795 Sep 09 20:58:50.732800 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Sep 9 20:58:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 20:58:50.742669 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-c41255b7-7dff-497d-bf55-e0ef556d9e54 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:50.748826 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.wsgi [None req-c41255b7-7dff-497d-bf55-e0ef556d9e54 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-c41255b7-7dff-497d-bf55-e0ef556d9e54 admin admin] Request method failure captured: Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Accept: application/json Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Accept-Encoding: gzip, deflate Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Connection: keep-alive Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Content-Length: 0 Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Host: 10.222.0.48 Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Openstack-Api-Version: compute 2.92 Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Openstack-System-Scope: None Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: User-Agent: python-novaclient Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Auth-Token: gAAAAABjG6kKBmUMmXR3DZHhQOVq0JQtXt-MGXqy5Ht2CniKCJsTyTobUOhH1jmzgMtVZ2zB1x7hX8nuo0HyACkHQ1vWNNOW-_8B4bOBKLBiFJEvHnVd6UFJx0VCMfZomS8NU5TdJFFlkP_9yUw9fOPS2DmD_Zgp7wyh0ma4RYyFjev5eapj2zo Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Domain-Id: None Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Domain-Name: None Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Identity-Status: Confirmed Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Is-Admin-Project: True Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Domain-Id: default Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Domain-Name: Default Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Name: admin Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Role: reader,admin,member Sep 09 20:58:50.752924 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Roles: reader,admin,member Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d43f38801344407291af57c99bc81066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d43f38801344407291af57c99bc81066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant: admin Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant-Name: admin Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User: admin Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Domain-Id: default Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Domain-Name: Default Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Id: 2e3a7a2557844cc78377f788a7c8c3ae Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Name: admin Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: method: > Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: exception: Flavor 42 could not be found. Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: action_args: {'id': '42'} Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:58:50.754398 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:50.755230 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:50.756303 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-c41255b7-7dff-497d-bf55-e0ef556d9e54 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:58:50.757370 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-c41255b7-7dff-497d-bf55-e0ef556d9e54 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014793 Sep 09 20:58:50.757370 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Sep 9 20:58:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 20:58:51.969771 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-ef03d17b-af61-48f1-9fa6-19f5b3ad00d7 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:51.970789 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-ef03d17b-af61-48f1-9fa6-19f5b3ad00d7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 09 20:58:51.971408 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 20:58:52.498271 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-609a7701-2415-449f-84de-62d8dec56d63 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:52.503262 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.wsgi [None req-609a7701-2415-449f-84de-62d8dec56d63 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-609a7701-2415-449f-84de-62d8dec56d63 admin admin] Request method failure captured: Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Accept: application/json Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Accept-Encoding: gzip, deflate Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Connection: keep-alive Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Content-Length: 0 Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Host: 10.222.0.48 Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Openstack-Api-Version: compute 2.92 Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Openstack-System-Scope: None Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: User-Agent: python-novaclient Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Auth-Token: gAAAAABjG6kL94YaSry495vRPr1Ed9vy43-51cOiEQTe4Ufy0DunvtLsGHi0ZjOBohOBlDSvaXZeC2qfrJUHm3KZDb_aB3IiALY2DmuIyevGPUHKIrSnNVfhYd85tKxve7MOJjXoi46tOV3beh1mgQZHEsifaPCdiVBRUw6Dgnrw7LSLAKF_Inw Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Domain-Id: None Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Domain-Name: None Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Identity-Status: Confirmed Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Is-Admin-Project: True Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Domain-Id: default Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Domain-Name: Default Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Name: admin Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Role: reader,admin,member Sep 09 20:58:52.504789 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Roles: reader,admin,member Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d43f38801344407291af57c99bc81066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d43f38801344407291af57c99bc81066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant: admin Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant-Name: admin Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User: admin Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Domain-Id: default Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Domain-Name: Default Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Id: 2e3a7a2557844cc78377f788a7c8c3ae Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Name: admin Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: method: > Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: exception: Flavor 84 could not be found. Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: action_args: {'id': '84'} Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:58:52.506313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:52.507348 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.508759 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-609a7701-2415-449f-84de-62d8dec56d63 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:58:52.509996 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-609a7701-2415-449f-84de-62d8dec56d63 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395719 Sep 09 20:58:52.509996 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Sep 9 20:58:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:52.516592 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-4371842c-b973-4f4d-a32b-229d56c03733 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:52.531660 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-4371842c-b973-4f4d-a32b-229d56c03733 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018614 Sep 09 20:58:52.532225 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Sep 9 20:58:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:52.545101 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-a4310b5f-f536-4d38-b4f9-7ef426e2fb09 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:52.561248 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-a4310b5f-f536-4d38-b4f9-7ef426e2fb09 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020044 Sep 09 20:58:52.561769 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Sep 9 20:58:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:52.571164 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-3985e49d-43fe-4bcf-aa09-6d84486a30a9 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:52.576875 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.wsgi [None req-3985e49d-43fe-4bcf-aa09-6d84486a30a9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-3985e49d-43fe-4bcf-aa09-6d84486a30a9 admin admin] Request method failure captured: Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Accept: application/json Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Accept-Encoding: gzip, deflate Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Connection: keep-alive Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Content-Length: 0 Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Host: 10.222.0.48 Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Openstack-Api-Version: compute 2.92 Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Openstack-System-Scope: None Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: User-Agent: python-novaclient Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Auth-Token: gAAAAABjG6kL94YaSry495vRPr1Ed9vy43-51cOiEQTe4Ufy0DunvtLsGHi0ZjOBohOBlDSvaXZeC2qfrJUHm3KZDb_aB3IiALY2DmuIyevGPUHKIrSnNVfhYd85tKxve7MOJjXoi46tOV3beh1mgQZHEsifaPCdiVBRUw6Dgnrw7LSLAKF_Inw Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Domain-Id: None Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Domain-Name: None Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Identity-Status: Confirmed Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Is-Admin-Project: True Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Domain-Id: default Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Domain-Name: Default Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Name: admin Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Role: reader,admin,member Sep 09 20:58:52.578369 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Roles: reader,admin,member Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d43f38801344407291af57c99bc81066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d43f38801344407291af57c99bc81066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant: admin Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant-Name: admin Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User: admin Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Domain-Id: default Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Domain-Name: Default Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Id: 2e3a7a2557844cc78377f788a7c8c3ae Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Name: admin Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: method: > Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: exception: Flavor 84 could not be found. Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: action_args: {'id': '84'} Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:58:52.579833 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:52.580813 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:52.582173 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-3985e49d-43fe-4bcf-aa09-6d84486a30a9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:58:52.583410 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-3985e49d-43fe-4bcf-aa09-6d84486a30a9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012348 Sep 09 20:58:52.583410 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Sep 9 20:58:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:53.794136 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-a4310b5f-f536-4d38-b4f9-7ef426e2fb09 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:53.795130 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-a4310b5f-f536-4d38-b4f9-7ef426e2fb09 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 09 20:58:53.795519 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:54.312812 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-502b3db5-b48d-4d37-875f-4a73bb3277a0 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:54.318901 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.wsgi [None req-502b3db5-b48d-4d37-875f-4a73bb3277a0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-502b3db5-b48d-4d37-875f-4a73bb3277a0 admin admin] Request method failure captured: Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Accept: application/json Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Accept-Encoding: gzip, deflate Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Connection: keep-alive Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Content-Length: 0 Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Host: 10.222.0.48 Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Openstack-Api-Version: compute 2.92 Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Openstack-System-Scope: None Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: User-Agent: python-novaclient Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Auth-Token: gAAAAABjG6kNrJf0I8fkFm9o4yZVyp7OY4xFI3Q40XYVLtKc52C1mLPjxBqa0kXeeYhCNODfAiAIgMft4MjYVa4JgUs-tHxxLkbBgTj1lJfqlX85gE_6r0UBrFzphgKoF0RfX4uRbCIpD-l_Kw83zrbFw1L3l1I6DUtCJIv6inQNyAlblwtvEBo Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Domain-Id: None Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Domain-Name: None Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Identity-Status: Confirmed Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Is-Admin-Project: True Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Domain-Id: default Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Domain-Name: Default Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Project-Name: admin Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Role: reader,admin,member Sep 09 20:58:54.320437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Roles: reader,admin,member Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d43f38801344407291af57c99bc81066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d43f38801344407291af57c99bc81066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant: admin Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-Tenant-Name: admin Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User: admin Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Domain-Id: default Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Domain-Name: Default Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Id: 2e3a7a2557844cc78377f788a7c8c3ae Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: X-User-Name: admin Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: method: > Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: exception: Flavor 451 could not be found. Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: action_args: {'id': '451'} Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:58:54.321911 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:54.322709 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.324417 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-502b3db5-b48d-4d37-875f-4a73bb3277a0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:58:54.325426 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-502b3db5-b48d-4d37-875f-4a73bb3277a0 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388291 Sep 09 20:58:54.325426 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Sep 9 20:58:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:54.332227 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-f05390c0-322e-4a78-8403-86cb04e0def9 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:54.347511 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-f05390c0-322e-4a78-8403-86cb04e0def9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018839 Sep 09 20:58:54.348034 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Sep 9 20:58:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:54.357643 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:54.373185 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019463 Sep 09 20:58:54.373702 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Sep 9 20:58:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 20:58:54.382757 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-2766c842-922c-4b00-9a83-c3247d3963ae admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:54.387526 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.wsgi [None req-2766c842-922c-4b00-9a83-c3247d3963ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-2766c842-922c-4b00-9a83-c3247d3963ae admin admin] Request method failure captured: Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Accept: application/json Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Accept-Encoding: gzip, deflate Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Connection: keep-alive Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Content-Length: 0 Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Host: 10.222.0.48 Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Openstack-Api-Version: compute 2.92 Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Openstack-System-Scope: None Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: User-Agent: python-novaclient Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Auth-Token: gAAAAABjG6kNrJf0I8fkFm9o4yZVyp7OY4xFI3Q40XYVLtKc52C1mLPjxBqa0kXeeYhCNODfAiAIgMft4MjYVa4JgUs-tHxxLkbBgTj1lJfqlX85gE_6r0UBrFzphgKoF0RfX4uRbCIpD-l_Kw83zrbFw1L3l1I6DUtCJIv6inQNyAlblwtvEBo Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Domain-Id: None Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Domain-Name: None Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Identity-Status: Confirmed Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Is-Admin-Project: True Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Domain-Id: default Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Domain-Name: Default Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Project-Name: admin Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Role: reader,admin,member Sep 09 20:58:54.389058 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Roles: reader,admin,member Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d43f38801344407291af57c99bc81066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d43f38801344407291af57c99bc81066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d43f38801344407291af57c99bc81066"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant: admin Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant-Id: d43f38801344407291af57c99bc81066 Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-Tenant-Name: admin Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User: admin Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Domain-Id: default Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Domain-Name: Default Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Id: 2e3a7a2557844cc78377f788a7c8c3ae Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: X-User-Name: admin Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: method: > Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: exception: Flavor 451 could not be found. Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: action_args: {'id': '451'} Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 20:58:54.390381 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:54.391163 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: ERROR nova.api.openstack.wsgi Sep 09 20:58:54.392334 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-2766c842-922c-4b00-9a83-c3247d3963ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 20:58:54.393366 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-2766c842-922c-4b00-9a83-c3247d3963ae admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011104 Sep 09 20:58:54.393366 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Sep 9 20:58:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 09 20:58:55.612860 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:55.613866 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 09 20:58:55.614438 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:56.131459 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-e65e5908-21be-4189-9c7e-3dd25ee8ea2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:56.195313 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-e65e5908-21be-4189-9c7e-3dd25ee8ea2a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.443948 Sep 09 20:58:56.195884 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Sep 9 20:58:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 20:58:57.403182 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:57.404219 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 09 20:58:57.404614 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:57.920869 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-4ef08add-f6d7-4a8b-904c-ffd4c5718d76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:58:58.036086 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-4ef08add-f6d7-4a8b-904c-ffd4c5718d76 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.495323 Sep 09 20:58:58.036639 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Sep 9 20:58:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:58:59.262439 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:58:59.263421 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 09 20:58:59.263814 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:58:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:58:59.906720 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-aa3ee91f-c5bf-4836-9816-7aadeb5eeaa4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:59:00.047762 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-aa3ee91f-c5bf-4836-9816-7aadeb5eeaa4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.639809 Sep 09 20:59:00.048271 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Sep 9 20:58:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:59:01.271240 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:59:01.272285 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 09 20:59:01.272680 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:59:01.788869 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-47432c1e-6652-4fbf-b285-eeee2d13022e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 20:59:01.860340 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-47432c1e-6652-4fbf-b285-eeee2d13022e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.447803 Sep 09 20:59:01.860807 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Sep 9 20:59:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 20:59:03.080844 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:59:03.081856 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 09 20:59:03.082256 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 20:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 20:59:03.605917 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-9ffc9f8d-920b-4917-99ef-61e2e9d4ee1f admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 20:59:03.625864 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-9ffc9f8d-920b-4917-99ef-61e2e9d4ee1f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403213 Sep 09 20:59:03.626395 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Sep 9 20:59:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:00:00.240168 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:00:00.241202 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-efcd3c18-d035-487e-ba4e-67be94e2518c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 09 21:00:00.241574 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Fri Sep 9 21:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:00:00.252268 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:00.635585 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-c92bbaf0-4d2b-468f-9b0d-3660065f620d admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:00:00.655879 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-c92bbaf0-4d2b-468f-9b0d-3660065f620d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407986 Sep 09 21:00:00.656445 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Fri Sep 9 21:00:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:00:00.677544 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=14 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:00.681889 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-02b23596-5808-4647-9902-084a08d72834 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:00:00.689074 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-02b23596-5808-4647-9902-084a08d72834 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012954 Sep 09 21:00:00.689585 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Fri Sep 9 21:00:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:00:00.701354 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-2f95197a-34c9-493e-9695-940e6f58026f admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:00:00.708580 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-2f95197a-34c9-493e-9695-940e6f58026f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010795 Sep 09 21:00:00.709092 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Fri Sep 9 21:00:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:00:00.720882 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:00:00.727978 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010792 Sep 09 21:00:00.729106 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Fri Sep 9 21:00:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:00:00.740166 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-465d1f93-54ad-4e73-a62c-66f00f280d02 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:00:00.747259 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-465d1f93-54ad-4e73-a62c-66f00f280d02 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010548 Sep 09 21:00:00.747765 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Fri Sep 9 21:00:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:03:18.318958 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:18.319968 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 09 21:03:18.320396 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 21:03:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:03:18.459116 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=6 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:18.615852 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:18.620524 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:18.620999 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:18.621434 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:18.622149 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:18.622594 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:18.623014 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:18.654322 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-6f511236-c423-4f09-96f9-95582fac6860 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.196411 Sep 09 21:03:18.654873 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Sep 9 21:03:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:03:19.726022 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:19.727023 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 09 21:03:19.727415 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 21:03:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:03:19.921339 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:19.924968 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:19.925521 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:19.926056 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:19.926842 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:19.927369 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:19.927860 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:19.947681 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-d1bb5f0f-2ae7-4382-9929-0b5886b65169 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.080078 Sep 09 21:03:19.948537 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Sep 9 21:03:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:03:31.424475 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:31.425503 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 09 21:03:31.425894 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 21:03:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:03:31.568850 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell0:SELECT=4 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:31.569576 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_cell1:SELECT=4 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:31.570198 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG dbcounter [-] [106084] Writing DB stats nova_api:SELECT=8 {{(pid=106084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:31.618217 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:31.621771 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:31.624632 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:31.624632 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:31.624632 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:31.624632 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:31.625088 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:31.650546 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-0808f18b-be1b-4d89-850c-2879397371d5 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.086019 Sep 09 21:03:31.651105 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Sep 9 21:03:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:03:32.717437 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG nova.api.openstack.wsgi [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] Calling method '>' {{(pid=106083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:32.718450 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: INFO nova.api.openstack.requestlog [None req-8b91dfec-8c57-4289-a345-b6e615eb63b3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 09 21:03:32.718854 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: [pid: 106083|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Sep 9 21:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:03:32.908410 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG nova.api.openstack.wsgi [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Calling method '>' {{(pid=106084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:03:32.912036 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:32.912542 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:32.912961 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:32.913663 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:03:32.914102 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:03:32.914512 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: DEBUG oslo_concurrency.lockutils [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:03:32.935991 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: INFO nova.api.openstack.requestlog [None req-927e17c5-6980-4675-b211-529d75950970 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078144 Sep 09 21:03:32.936550 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: [pid: 106084|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Sep 9 21:03:32 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:04:32.303902 dv-cinder-831247-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 21:04:32.304488 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: Fri Sep 9 21:04:32 2022 - graceful shutdown triggered... Sep 09 21:04:32.304945 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: Gracefully killing worker 1 (pid: 106083)... Sep 09 21:04:32.305467 dv-cinder-831247-28-iscsi devstack@n-api.service[106084]: Gracefully killing worker 2 (pid: 106084)... Sep 09 21:04:32.432465 dv-cinder-831247-28-iscsi devstack@n-api.service[106083]: DEBUG dbcounter [-] [106083] Writing DB stats nova_api:SELECT=4 {{(pid=106083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:04:33.305706 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: worker 1 buried after 1 seconds Sep 09 21:04:33.305706 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: worker 2 buried after 1 seconds Sep 09 21:04:33.305706 dv-cinder-831247-28-iscsi devstack@n-api.service[106082]: goodbye to uWSGI. Sep 09 21:04:33.307735 dv-cinder-831247-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 21:04:33.308321 dv-cinder-831247-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 21:04:33.311125 dv-cinder-831247-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 21:04:33.325826 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 21:04:33 2022] *** Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: nodename: dv-cinder-831247-28-iscsi Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: machine: x86_64 Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: clock source: unix Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: pcre jit disabled Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: detected number of CPU cores: 4 Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: current working directory: / Sep 09 21:04:33.327800 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: detected binary path: /usr/bin/uwsgi-core Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: your processes number limit is 47680 Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: your memory page size is 4096 bytes Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: detected max file descriptor number: 2048 Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: lock engine: pthread robust mutexes Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: thunder lock: enabled Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 21:04:33.328533 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 21:04:33.369620 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: Python main interpreter initialized at 0x55cf573ae9c0 Sep 09 21:04:33.369620 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: python threads support enabled Sep 09 21:04:33.369620 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: your server socket listen backlog is limited to 100 connections Sep 09 21:04:33.369620 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: your mercy for graceful operations on workers is 90 seconds Sep 09 21:04:33.370048 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 21:04:33.370048 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: *** Operational MODE: preforking *** Sep 09 21:04:33.370313 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: *** uWSGI is running in multiple interpreter mode *** Sep 09 21:04:33.370313 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: spawned uWSGI master process (pid: 121118) Sep 09 21:04:33.370554 dv-cinder-831247-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 21:04:33.375732 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: spawned uWSGI worker 1 (pid: 121136, cores: 1) Sep 09 21:04:33.375732 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: spawned uWSGI worker 2 (pid: 121137, cores: 1) Sep 09 21:04:33.375732 dv-cinder-831247-28-iscsi devstack@n-api.service[121118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 21:04:34.033899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 21:04:34.051548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 21:04:35.206219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:04:35.206219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: from cryptography.utils import int_from_bytes Sep 09 21:04:35.206862 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:04:35.206862 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: from cryptography.utils import int_from_bytes Sep 09 21:04:35.217930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:04:35.217930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: from cryptography.utils import int_from_bytes Sep 09 21:04:35.218417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 21:04:35.218417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: from cryptography.utils import int_from_bytes Sep 09 21:04:37.645547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:04:37.646129 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:04:37.646354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:04:37.646728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:04:37.646987 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:04:37.647381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.647710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.648034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.648472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.648820 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.649138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.650008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.650332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.650663 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.650928 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.651250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.651732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-28-iscsi {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.652062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.652419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.652718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.653038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.653347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.653678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.653990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.654505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.654948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.655262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.655578 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.655922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.656869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.656869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.656869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.657190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.657518 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.657820 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.658291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-28-iscsi {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.658532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.658839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.659159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.659579 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.659892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.660224 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.660731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.660839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 21:04:37.661257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 21:04:37.661617 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 21:04:37.661742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.661981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 21:04:37.662109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.662245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 21:04:37.662631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.662757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.662846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.662936 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.663027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.663268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.663396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.663603 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.663715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.663914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.664978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.665759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.665881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-28-iscsi {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.666979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.667132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.667307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.667450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.667604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.667754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.667844 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.668106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.668219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.668413 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.668517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.668740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.668842 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669358 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.669983 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.670193 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.670352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.670560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.670675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.670844 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.670936 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.671162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.671267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.671476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.671568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.671800 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.671897 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.672131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.672243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.672461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.672645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.672780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.672918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.673151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.673252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-28-iscsi {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.673461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.673652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.673793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.673889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.674078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.674177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.674419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.674515 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.674743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.674850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.675069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.675168 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.675381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.675479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.675690 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.675795 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676195 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676473 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.676994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677248 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677352 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677862 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.677961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.678185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.678285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.678497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.678589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.678807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.678898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.679115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.679213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.679375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.679497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.679691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.679817 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.680949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681299 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681532 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.681959 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.682165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.682257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.682471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.682572 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.682783 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.682896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.683098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.683190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.683406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.683509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.683717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.683871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684777 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.684995 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.685097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.685305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.685409 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.685620 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.685719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.685927 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686164 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686541 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.686975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.687163 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.687269 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.687487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.687585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.687783 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.688101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.688429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.688606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.688735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.688948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.689037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.689283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.689361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.689603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.689718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.689920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690027 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.690943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.691138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.691252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.691428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.691737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.691915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.692121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.692290 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.692449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.692595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.692748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.692958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.693113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.693277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.693422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.693573 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.693719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.693877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.694030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.694183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.694335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.694486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.694637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.694799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.694944 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.695094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.695256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.695402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.695554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.695711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.695855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.696004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.696709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.696860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.697018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.697163 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.697307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.697457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.697607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.697760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.697917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.698070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.698221 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.698366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.698696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.698857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.699009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.699404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.699561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.699721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.699865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.700025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.700205 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.700359 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.700511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.700669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.700821 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.700979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.701123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.701267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.701411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.701569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.701819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.701969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.702135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.702286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.702445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.702591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.702734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.702922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.703078 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.703223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.703382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.703527 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.703679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.703832 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.703976 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.704307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.704307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.704615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.704772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.704925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.705071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.705215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.705371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.705515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.705669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.705814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.705972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.706129 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.706291 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.706445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.706590 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.706746 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.706890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.707033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.707186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.707338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.707491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.707635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.707787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.707931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.708111 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 21:04:37.708280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.708434 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.708604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.708901 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709060 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709366 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.709980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.710274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.710424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.710567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.710721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.710939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.711093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.711243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.711388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.711532 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.711676 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.711847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.712647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.712807 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713475 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.713932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.714085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.714243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.714400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.714554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.714717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.714873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715615 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.715911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716244 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.716996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.717149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.717296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.717440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.717590 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.717741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.717898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.718043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.718195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.718348 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.718500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.718500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.718793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719708 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719853 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.719996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.720163 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.720321 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.720474 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.720627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.720780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.720935 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.721086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.721230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.721385 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.721551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.721697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.721847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.722000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.722144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.722296 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.722441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.722609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.722858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723509 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.723953 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.724127 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.724292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.724444 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.724597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.724745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.724908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725212 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.725954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.726111 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.726256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.726399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.726542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.727238 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.727418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.727566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.727721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.727873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728218 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.728965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.729257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.729426 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.729647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.729801 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.729953 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.730104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.730257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.730417 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.730562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.730714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.730870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.731015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.731173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.732166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.732331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.732493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.732649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.732802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.733064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.733271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.733418 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.733571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.733724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.733878 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734034 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.734972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.735126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.735278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.735422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.735575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.735728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.735872 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.736016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.736217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.736374 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.736529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.736692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.736850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.737027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.742384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.743818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.743989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.744174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.744337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.744488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.744634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.744794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.744944 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.745097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.745253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.745399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.745551 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.745696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.745846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.746010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.746165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.746165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.746456 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.746739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.746934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.747095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.747251 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.747396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.747548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.747694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.747847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.748138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.748322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.748480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.748634 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.748778 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.748930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.749090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.749244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.749550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.749710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.749856 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.750931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.751092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.751569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.751784 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.751946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.752111 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.752281 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.752281 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.752565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.752728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.752881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753189 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.753990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.754148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.754300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.754444 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.754594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.754750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.754913 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755513 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755655 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.755961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.756125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.756276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.756431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.756586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.756754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.756906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757051 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.757996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.758141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.758291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.758443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.758596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.759278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.759436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.759590 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.759743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.759888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760680 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.760984 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.761135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.761308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.761615 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.762325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.762497 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.762645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.762790 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.762941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.763094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.763239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.763444 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.763605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.763756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.763919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.764981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.765138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.765290 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.765455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.765609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.765760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.765915 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766659 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.766969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.767123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.767275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.767419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.767563 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.767563 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.767865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.768942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.769103 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.769255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.769414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.769579 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.769742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.769893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.770050 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.770210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.770367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.770528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.770680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.770901 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.771070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.771222 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.771372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.771547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.771865 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.772029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.772369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.772615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.772775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.772927 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773245 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.773981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.774276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.775159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.775316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.775475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.775641 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.775794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.775956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.776185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.776354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.776507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.776666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.776826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.777949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.778102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.778253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.778404 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.778562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.778734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.779041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.779201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.779353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.779523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.779682 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.779842 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780003 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.780971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.781124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.781275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.781436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.781638 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.782010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.782173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.782345 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.782570 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.782858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783024 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.783887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.784232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.784388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.784550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.784709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.784911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.785084 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.785236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.785393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.785559 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.785719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.785883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.786992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.787144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.787294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.787454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.787606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.787756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.787907 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.788109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.788281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.788492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.788647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.788805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.788965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.789117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.789268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.789427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.789588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.789747 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.789899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.790087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.790260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.790420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.790573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.790723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.790881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.791032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.791191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.791343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.791493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.791643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.791807 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.792058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.792253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.792425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.792595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.792828 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.793083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.793249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.793421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.793580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.793791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.793953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.794120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.794288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.794448 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.794599 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.794769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.794928 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.795088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.795254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.795412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.795568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.795726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.795885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.796044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.796241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.796395 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.796546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.796707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.796868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797338 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.797797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.798095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.798246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.798404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.798555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.798723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.798884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799655 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.799975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.800170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.800330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.800330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.800629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.800798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.800958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.801118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.801270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.801421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.801585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.801744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.801895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.802071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.802302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.802458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.802623 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.802798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.803031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.803296 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.803461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.803613 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.803822 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.803980 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.804207 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.804376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.804528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.804679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.804840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.804993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.805150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.805314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.805476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.805993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.806162 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.806317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.806468 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.806626 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.806778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.806943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.807096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.807255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.807416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.807588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.807741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.807900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.808061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.808239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.808393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.808543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.808694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.808857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809792 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.809944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.810101 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.810260 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.810419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.810585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.810744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.810896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.811054 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.811214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.811373 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.811546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.811721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.811879 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.812031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.812226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.812478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.812691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.812856 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.813744 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.813956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.814125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.814288 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.814449 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.814610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.814774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.814932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.815092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.815254 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.815415 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.815569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.815739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.815893 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.816052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.816247 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.816408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.816561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.816730 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.819300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.819476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.819651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.819808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.819962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.820159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.820363 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.820538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.820700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.820853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.821014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.821166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.821878 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.822047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.822200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.822360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.822608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.822768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.822922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.823154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.823308 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.823459 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.823610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.823980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.824424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.824608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.824763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.824914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.825073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.825232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.825391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.825557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.825710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.825861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.826020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.826183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.826349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.826510 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.826685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.826845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827610 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.827921 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.828131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.828303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.828457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.828619 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.828789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.828941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.829100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.829265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.829418 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.829568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.829726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.829885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830503 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830664 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.830984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.831144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.831295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.831445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.831597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.831747 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.831912 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.832064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.832353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.832518 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.832762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.832878 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.832975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833156 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833248 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.833846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834157 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834628 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834738 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834857 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.834969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835216 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835579 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.835818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836193 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836456 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.836789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.837454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.837588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.837710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.837825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.837936 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838172 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838518 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.838968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839087 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839200 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839310 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.839887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840865 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.840980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.841896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.842007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.842132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.842259 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.842449 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.842619 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.842788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.843019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.843186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.843407 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.843560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.843721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.843873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.844058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.844444 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.844598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.844750 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.844902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845539 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845842 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845999 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.845999 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.846326 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.846480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.846639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.846798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.847042 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.847230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.847395 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.847548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.847699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.847859 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.848012 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.848214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.848371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.848529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.848688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.848848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.849000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.849175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.849356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.849598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.849755 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.849914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850983 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.850983 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.851281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.851441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.851600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.851751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.851964 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.852149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.852307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.852491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.852658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.852834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.853023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.853254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.853422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.853595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.853756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.853915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.854080 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.854259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.854600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.854600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.854909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.855062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.855223 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.855376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.855544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.856275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.856459 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.856623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.856777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.856929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.857088 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.857241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.857394 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.857554 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.857707 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.857860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.858951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.859102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.859355 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.859537 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.859699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.859860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.860021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.860209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.860390 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.860544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.860697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.860857 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861484 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861648 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.861962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.862122 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.862299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.862451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.862611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.862611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.862900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.863062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.863238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.863468 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.863636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.863789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.863941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.864158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.864330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.864623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.864792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.864953 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.865116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.865294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.865536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.865693 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.865853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.866973 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.867136 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.867289 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.867450 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.867610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.867762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.867921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.868130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.868307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.868462 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.868621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.868792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.868955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.869109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.869261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.869421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.869575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.869726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.869886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.870047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.870200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.870360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.870512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.870671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.870844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.871006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.871166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.871327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.871480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.871650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.871892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.872062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.872062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.872484 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.872643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.872815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.872969 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.873132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.873285 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.873463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.873702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.873870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.874025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.874185 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.874185 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.874492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.874762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.874996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.875159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.875334 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.875494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.875760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.875928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.876117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.876277 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.876440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.876600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.876753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.876913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.877066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.877224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.877377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.877546 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.877700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.877860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878180 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.878982 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.879143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.879302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.879464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.879627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.879794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.879955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.880135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.880294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.880480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.881231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.881396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.881556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.881724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.881886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.882060 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.882221 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.882380 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.882548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.882708 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.882862 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.883023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.883175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.883334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.883486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.884226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.884479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.884648 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.884919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.885087 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.885242 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.885393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.885556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.885709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.885973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.886133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.886296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.887071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.887238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.887238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.887540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.887701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.887861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.888013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.888246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.888400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.888571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.888724 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.888883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.889034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.889186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.889349 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.889516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.889676 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.889837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890163 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890324 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890800 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.890951 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.891102 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.891254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.891424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.891424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.891721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.891882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.892035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.892225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.892388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.892550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.892703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.892855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.893983 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.894196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.894364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.894658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.894827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.895097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.895265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.895431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.895584 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.895747 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.895907 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.896197 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.896384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.896550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.896704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.896855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897342 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897496 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.897982 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.898134 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.898296 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.898448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.898609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.898769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.898936 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.899097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.899257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.899974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.900152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.900323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.900495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.900880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.900996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901085 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901609 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.901871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902390 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.902923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903200 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.903934 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.904121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.904286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.904420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.904557 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.904771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.904893 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.905139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.905279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.905395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.905542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.905675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.905803 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.906161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.906402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.906538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.906676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.906812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907290 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907475 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.907919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908014 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908720 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.908914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909103 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.909921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910466 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910835 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.910933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911195 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911662 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.911924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.912931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913112 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.913952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914051 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914222 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914503 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914683 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.914978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915075 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.915932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916417 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916684 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916851 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.916951 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917579 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.917978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918339 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.918923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919205 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919291 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919575 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.919939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920655 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920907 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.920999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.921734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.922530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.923815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.924450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.925863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.926200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.926522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.926859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 21:04:37.927088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 21:04:37.973337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO dbcounter [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Registered counter for database nova_api Sep 09 21:04:37.989945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO dbcounter [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Registered counter for database nova_api Sep 09 21:04:37.994003 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_db.sqlalchemy.engines [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.000726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writer thread running {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.010623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_db.sqlalchemy.engines [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.020138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writer thread running {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.058729 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.context [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ceb83d-97f3-4964-9e40-c191a7de62e9(cell1) {{(pid=121136) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 21:04:38.062808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:04:38.063287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:04:38.064894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:04:38.065642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:04:38.066090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:04:38.068090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:04:38.070086 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO dbcounter [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Registered counter for database nova_cell0 Sep 09 21:04:38.075062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO dbcounter [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Registered counter for database nova_cell1 Sep 09 21:04:38.078161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.context [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2ceb83d-97f3-4964-9e40-c191a7de62e9(cell1) {{(pid=121137) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 21:04:38.082272 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:04:38.082451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_db.sqlalchemy.engines [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.082765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:04:38.084397 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:04:38.085162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:04:38.085613 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:04:38.085740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_db.sqlalchemy.engines [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.087675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:04:38.088718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writer thread running {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.090425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO dbcounter [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Registered counter for database nova_cell0 Sep 09 21:04:38.096613 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO dbcounter [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Registered counter for database nova_cell1 Sep 09 21:04:38.104276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_db.sqlalchemy.engines [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.108311 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_db.sqlalchemy.engines [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.109912 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writer thread running {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.228973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writer thread running {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.237769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO dbcounter [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Registered counter for database nova_cell0 Sep 09 21:04:38.245176 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_db.sqlalchemy.engines [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.249707 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writer thread running {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.252346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writer thread running {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.261766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO dbcounter [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Registered counter for database nova_cell0 Sep 09 21:04:38.269300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_db.sqlalchemy.engines [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 21:04:38.273750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writer thread running {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 21:04:38.587930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: WARNING keystonemiddleware.auth_token [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:04:38.588161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: WARNING keystonemiddleware.auth_token [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:04:38.595322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: WARNING keystonemiddleware.auth_token [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:04:38.603173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: WARNING keystonemiddleware.auth_token [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:04:38.934781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: WARNING keystonemiddleware.auth_token [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:04:38.940885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: WARNING keystonemiddleware.auth_token [None req-9442dd72-0c00-4a6f-a8d3-1b110a5efa9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:04:38.946276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf573ae9c0 pid: 121136 (default app) Sep 09 21:04:38.949908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: WARNING keystonemiddleware.auth_token [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 21:04:38.955961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: WARNING keystonemiddleware.auth_token [None req-6c49af20-fb63-4073-b39e-22dedb179fee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 21:04:38.961247 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cf573ae9c0 pid: 121137 (default app) Sep 09 21:05:16.068527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.072043 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.074095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.075451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.372802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.373982 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.375874 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:16.377095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:17.415399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c6dbfe8d-5ca9-4ca4-8e17-4005f722a2ee tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Action: 'create', calling method: .version_select at 0x7fa1d195d3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-961949938", "metadata": {"Type": "work"}}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:17.635404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1beee625-2569-4a0a-8d36-b1ccffaeecdd tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Action: 'create', calling method: .version_select at 0x7fa1d195d3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-446632613", "metadata": {"Type": "work"}}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1beee625-2569-4a0a-8d36-b1ccffaeecdd tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Request method failure captured: Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 121 Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qMDjguNw0Gv3auSfXVy4z1XRtzPtu7cc35whF3zMU64XcpHWc-UVOftkxQkIKf584ztFwciqrQmyAPXU0c9gRb3XxnP9SE8LDaovA8zIjk_nCp9BX_20FpZ2kuJoVDoQxdhEkngf3pnvFhTGL6B080NuiRCywzP5-GYn2t5cndYfU Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:17.642201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 2f9fd461fa8840dbb1123e14db7740f3 Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-446632613", "metadata": {"Type": "work"}}} Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:17.644265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-446632613', 'metadata': {'Type': 'work'}}}} Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise error Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:17.645104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 21:05:17.647646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 21:05:17.649008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 21:05:17.649008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.649008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1beee625-2569-4a0a-8d36-b1ccffaeecdd tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:17.649008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1beee625-2569-4a0a-8d36-b1ccffaeecdd tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.293952 Sep 09 21:05:17.649008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Sep 9 21:05:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:05:17.655986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-982c5ac3-9a43-4ce7-8892-5633de1146ab tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Action: 'create', calling method: .version_select at 0x7fa1d195df70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-478133732", "metadata": {"Type": "work"}}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-982c5ac3-9a43-4ce7-8892-5633de1146ab tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Request method failure captured: Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 119 Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qMDjguNw0Gv3auSfXVy4z1XRtzPtu7cc35whF3zMU64XcpHWc-UVOftkxQkIKf584ztFwciqrQmyAPXU0c9gRb3XxnP9SE8LDaovA8zIjk_nCp9BX_20FpZ2kuJoVDoQxdhEkngf3pnvFhTGL6B080NuiRCywzP5-GYn2t5cndYfU Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:17.666831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 2f9fd461fa8840dbb1123e14db7740f3 Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-478133732", "metadata": {"Type": "work"}}} Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:17.671769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-478133732', 'metadata': {'Type': 'work'}}}} Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise error Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi '0' Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:17.672882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 21:05:17.674171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 21:05:17.675965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 21:05:17.675965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.675965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-982c5ac3-9a43-4ce7-8892-5633de1146ab tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:17.675965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-982c5ac3-9a43-4ce7-8892-5633de1146ab tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018388 Sep 09 21:05:17.675965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Sep 9 21:05:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:05:17.682499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-23495a4a-0472-4de0-8c38-92a705117a83 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Action: 'create', calling method: .version_select at 0x7fa1d1813160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1108689062", "metadata": {"Type": "work"}}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-23495a4a-0472-4de0-8c38-92a705117a83 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Request method failure captured: Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 119 Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qMDjguNw0Gv3auSfXVy4z1XRtzPtu7cc35whF3zMU64XcpHWc-UVOftkxQkIKf584ztFwciqrQmyAPXU0c9gRb3XxnP9SE8LDaovA8zIjk_nCp9BX_20FpZ2kuJoVDoQxdhEkngf3pnvFhTGL6B080NuiRCywzP5-GYn2t5cndYfU Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:17.686112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 2f9fd461fa8840dbb1123e14db7740f3 Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1108689062", "metadata": {"Type": "work"}}} Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:17.687432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1108689062', 'metadata': {'Type': 'work'}}}} Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise error Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi '' Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:17.688260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 21:05:17.690704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 21:05:17.693441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 21:05:17.693441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:17.693441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-23495a4a-0472-4de0-8c38-92a705117a83 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:17.693441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-23495a4a-0472-4de0-8c38-92a705117a83 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009839 Sep 09 21:05:17.693441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Sep 9 21:05:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:05:17.699611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7b42a4c1-cb32-4948-a89b-ffdb5f3d16a1 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Calling method '.version_select at 0x7fa1d1813c10>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-7b42a4c1-cb32-4948-a89b-ffdb5f3d16a1 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] HTTP exception thrown: Volume tempest-invalid-684584776 could not be found. Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7b42a4c1-cb32-4948-a89b-ffdb5f3d16a1 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Request method failure captured: Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-684584776 HTTP/1.1 Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qMDjguNw0Gv3auSfXVy4z1XRtzPtu7cc35whF3zMU64XcpHWc-UVOftkxQkIKf584ztFwciqrQmyAPXU0c9gRb3XxnP9SE8LDaovA8zIjk_nCp9BX_20FpZ2kuJoVDoQxdhEkngf3pnvFhTGL6B080NuiRCywzP5-GYn2t5cndYfU Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:18.262891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 2f9fd461fa8840dbb1123e14db7740f3 Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Volume tempest-invalid-684584776 could not be found. Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'tempest-invalid-684584776'} Sep 09 21:05:18.274775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-684584776 could not be found. (HTTP 404) (Request-ID: req-c6b0a8d7-312f-4e1f-b7a6-689ec3cfb4f1) Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.279437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:05:18.285431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-684584776 could not be found. Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:05:18.293131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-684584776 could not be found. Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-684584776 could not be found. Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7b42a4c1-cb32-4948-a89b-ffdb5f3d16a1 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Returning 404 to user: Volume tempest-invalid-684584776 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7b42a4c1-cb32-4948-a89b-ffdb5f3d16a1 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-684584776" status: 404 len: 98 microversion: 2.1 time: 0.379708 Sep 09 21:05:18.301120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1215 bytes} [Fri Sep 9 21:05:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-684584776 => generated 98 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 09 21:05:18.303753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0515cf61-475b-4089-b157-fe7ebc08de2d tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005556 Sep 09 21:05:18.303753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Sep 9 21:05:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 09 21:05:18.303753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-58c7480e-522c-4b46-8c1b-9d708256b81d tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010947 Sep 09 21:05:18.303753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1137 bytes} [Fri Sep 9 21:05:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 21:05:18.303753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d6f9a886-e065-43b5-b1af-95804387eead tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Calling method '.version_select at 0x7fa1d174c3a0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:18.574750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-d6f9a886-e065-43b5-b1af-95804387eead tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] HTTP exception thrown: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d6f9a886-e065-43b5-b1af-95804387eead tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Request method failure captured: Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: DELETE /compute/v2.1/os-volumes/dcd86124-b0a2-406b-bb43-757c66ef07d6 HTTP/1.1 Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qMDjguNw0Gv3auSfXVy4z1XRtzPtu7cc35whF3zMU64XcpHWc-UVOftkxQkIKf584ztFwciqrQmyAPXU0c9gRb3XxnP9SE8LDaovA8zIjk_nCp9BX_20FpZ2kuJoVDoQxdhEkngf3pnvFhTGL6B080NuiRCywzP5-GYn2t5cndYfU Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:18.577017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 2f9fd461fa8840dbb1123e14db7740f3 Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'dcd86124-b0a2-406b-bb43-757c66ef07d6'} Sep 09 21:05:18.587634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. (HTTP 404) (Request-ID: req-18543067-1665-43e4-9f2b-ef6730f9ba0d) Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.588690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:05:18.589780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 21:05:18.590801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d6f9a886-e065-43b5-b1af-95804387eead tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Returning 404 to user: Volume dcd86124-b0a2-406b-bb43-757c66ef07d6 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d6f9a886-e065-43b5-b1af-95804387eead tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/dcd86124-b0a2-406b-bb43-757c66ef07d6" status: 404 len: 109 microversion: 2.1 time: 0.440184 Sep 09 21:05:18.591826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:05:18 2022] DELETE /compute/v2.1/os-volumes/dcd86124-b0a2-406b-bb43-757c66ef07d6 => generated 109 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:05:18.592630 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c0b944a-77c7-4e71-8a8b-1b4186dd9838 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Calling method '.version_select at 0x7fa1d174c280>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:18.766673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-6c0b944a-77c7-4e71-8a8b-1b4186dd9838 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] HTTP exception thrown: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c0b944a-77c7-4e71-8a8b-1b4186dd9838 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Request method failure captured: Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/os-volumes/1ec49b4d-d56e-4181-a780-9ea91bfe9823 HTTP/1.1 Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qMDjguNw0Gv3auSfXVy4z1XRtzPtu7cc35whF3zMU64XcpHWc-UVOftkxQkIKf584ztFwciqrQmyAPXU0c9gRb3XxnP9SE8LDaovA8zIjk_nCp9BX_20FpZ2kuJoVDoQxdhEkngf3pnvFhTGL6B080NuiRCywzP5-GYn2t5cndYfU Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:18.780553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f1eaf427c6044461a8000994e2f4832c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: f1eaf427c6044461a8000994e2f4832c Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesNegativeTest-1073864679 Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 2f9fd461fa8840dbb1123e14db7740f3 Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesNegativeTest-1073864679-project Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '1ec49b4d-d56e-4181-a780-9ea91bfe9823'} Sep 09 21:05:18.781727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. (HTTP 404) (Request-ID: req-1b9afdea-7f62-49d6-9811-65c1091bab7b) Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.782488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:05:18.783847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:05:18.785025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c0b944a-77c7-4e71-8a8b-1b4186dd9838 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] Returning 404 to user: Volume 1ec49b4d-d56e-4181-a780-9ea91bfe9823 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6c0b944a-77c7-4e71-8a8b-1b4186dd9838 tempest-VolumesNegativeTest-1073864679 tempest-VolumesNegativeTest-1073864679-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1ec49b4d-d56e-4181-a780-9ea91bfe9823" status: 404 len: 109 microversion: 2.1 time: 0.188648 Sep 09 21:05:18.786171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:18 2022] GET /compute/v2.1/os-volumes/1ec49b4d-d56e-4181-a780-9ea91bfe9823 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:05:19.136520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c6dbfe8d-5ca9-4ca4-8e17-4005f722a2ee tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.097785 Sep 09 21:05:19.137473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1156 bytes} [Fri Sep 9 21:05:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3100 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 21:05:19.152859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-cb2d227d-61b6-46b1-86fe-a6c87e58dc25 tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Calling method '.version_select at 0x7fa1d1813e50>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:19.206248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-cb2d227d-61b6-46b1-86fe-a6c87e58dc25 tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2" status: 200 len: 352 microversion: 2.1 time: 0.057803 Sep 09 21:05:19.207029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:19 2022] GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:20.224483 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fb4766a5-9690-4fe6-a8fc-b142ff143d98 tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Calling method '.version_select at 0x7fa1d183d280>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:20.324639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fb4766a5-9690-4fe6-a8fc-b142ff143d98 tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2" status: 200 len: 353 microversion: 2.1 time: 0.107139 Sep 09 21:05:20.335754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:20 2022] GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:20.361483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d474cd00-084f-4412-828b-0fec2751ca85 tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Calling method '.version_select at 0x7fa1d174c940>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:20.505627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-efec5094-f457-4f83-bf87-4a515d84a527 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d183d940>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:20.529352 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d474cd00-084f-4412-828b-0fec2751ca85 tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2" status: 200 len: 353 microversion: 2.1 time: 0.185363 Sep 09 21:05:20.529917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 10/12] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:20 2022] GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:20.566734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bed51a54-1fca-4da2-83e6-3f095de1e3aa tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Calling method '.version_select at 0x7fa1d174c1f0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:20.662780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-efec5094-f457-4f83-bf87-4a515d84a527 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/271d4e77-4ca7-42a0-902f-4943630de136" status: 200 len: 351 microversion: 2.1 time: 0.162308 Sep 09 21:05:20.664529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 3/13] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:20 2022] GET /compute/v2.1/os-volumes/271d4e77-4ca7-42a0-902f-4943630de136 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:05:21.171205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bed51a54-1fca-4da2-83e6-3f095de1e3aa tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2" status: 202 len: 0 microversion: 2.1 time: 0.620093 Sep 09 21:05:21.172523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:05:20 2022] DELETE /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:05:21.184013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ffd6c558-aed8-4603-b3e7-1c96fe8f034a tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Calling method '.version_select at 0x7fa1d17ca0d0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:21.292049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ffd6c558-aed8-4603-b3e7-1c96fe8f034a tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2" status: 200 len: 352 microversion: 2.1 time: 0.116026 Sep 09 21:05:21.299280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:21 2022] GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:22.308595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-80262ba3-f751-4016-953b-941c65fa1bff tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Calling method '.version_select at 0x7fa1d174c8b0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:22.369098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-80262ba3-f751-4016-953b-941c65fa1bff tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] HTTP exception thrown: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-80262ba3-f751-4016-953b-941c65fa1bff tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Request method failure captured: Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 HTTP/1.1 Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qLP_I78U40TyGWZhTJndm9s795ms7TeaPldkKAH23_7dcdVLljpPeG_IWMOuPby2N4ZlOe0VcaXuK-bW4xQckQuDc6iymRl0i5qpfHMrXMhoIlRTeD8P7nKch8GYCycjln1ag9K446KDHLPYDu-14Z1CXEEzqaIs8EJk5X4hj7RLQ Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 4e7003778bfe41bbb0571fa23db64b7a Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesGetTestJSON-1204850332 Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:05:22.371586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7003778bfe41bbb0571fa23db64b7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4e7003778bfe41bbb0571fa23db64b7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4e7003778bfe41bbb0571fa23db64b7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4e7003778bfe41bbb0571fa23db64b7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesGetTestJSON-1204850332 Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 4e7003778bfe41bbb0571fa23db64b7a Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesGetTestJSON-1204850332 Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesGetTestJSON-1204850332-project Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 066eeca5e1e64725ab8081c34121b3ce Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesGetTestJSON-1204850332-project Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '79a14aef-76df-421a-abf2-5266f9ee29c2'} Sep 09 21:05:22.372976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. (HTTP 404) (Request-ID: req-3da87aa5-c308-4599-a738-c0e9f287f875) Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:22.373823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:05:22.374890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:05:22.375880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. Sep 09 21:05:22.376949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:05:22.379712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-80262ba3-f751-4016-953b-941c65fa1bff tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] Returning 404 to user: Volume 79a14aef-76df-421a-abf2-5266f9ee29c2 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:05:22.380761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-80262ba3-f751-4016-953b-941c65fa1bff tempest-VolumesGetTestJSON-1204850332 tempest-VolumesGetTestJSON-1204850332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2" status: 404 len: 109 microversion: 2.1 time: 0.078265 Sep 09 21:05:22.381711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:22 2022] GET /compute/v2.1/os-volumes/79a14aef-76df-421a-abf2-5266f9ee29c2 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:05:24.563285 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-30b1c7bd-41f4-4d22-8862-bb6f1abed1c7 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d183dca0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:24.705252 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-30b1c7bd-41f4-4d22-8862-bb6f1abed1c7 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/682c7a77-0407-49fd-bd35-04cda7fa3db7" status: 200 len: 351 microversion: 2.1 time: 0.146118 Sep 09 21:05:24.712236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:24 2022] GET /compute/v2.1/os-volumes/682c7a77-0407-49fd-bd35-04cda7fa3db7 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:26.511729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-817321109", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:26.723928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] validate_networks() for [('8868cdd0-53b5-4cee-ad5d-e353c07fbfb2', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:05:27.932713 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-aac76f3c-8175-434a-9586-97a34635559b tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d183d550>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:28.032771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-aac76f3c-8175-434a-9586-97a34635559b tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/67a1c3fa-3133-4441-b2e8-19cf204c46dd" status: 200 len: 350 microversion: 2.1 time: 0.103928 Sep 09 21:05:28.033351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 6/18] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:05:27 2022] GET /compute/v2.1/os-volumes/67a1c3fa-3133-4441-b2e8-19cf204c46dd => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:05:28.049291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e996ac26-ec96-421f-8e08-fcae15d83e28 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17ca1f0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:28.238449 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e996ac26-ec96-421f-8e08-fcae15d83e28 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.192920 Sep 09 21:05:28.239342 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 7/19] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Sep 9 21:05:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:28.256208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-72caad3e-6e3b-4ef2-9878-a248e68222dd tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17cadc0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:28.548655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-72caad3e-6e3b-4ef2-9878-a248e68222dd tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.296075 Sep 09 21:05:28.549658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 8/20] 10.222.0.48 () {58 vars in 1149 bytes} [Fri Sep 9 21:05:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:28.569585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bdcf6ee8-42bc-4705-829e-0f8712906bd5 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17d14c0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:28.765537 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bdcf6ee8-42bc-4705-829e-0f8712906bd5 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.200974 Sep 09 21:05:28.766233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 9/21] 10.222.0.48 () {58 vars in 1134 bytes} [Fri Sep 9 21:05:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:28.780231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ceb0588a-95f5-42dc-8044-f0408fe7783e tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17d1d30>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:29.005126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ceb0588a-95f5-42dc-8044-f0408fe7783e tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.228448 Sep 09 21:05:29.015780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 10/22] 10.222.0.48 () {58 vars in 1167 bytes} [Fri Sep 9 21:05:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:05:29.029528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6653cb1a-2ddd-493a-8fc8-25edd31626fd tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17ca550>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:29.297453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6653cb1a-2ddd-493a-8fc8-25edd31626fd tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.277638 Sep 09 21:05:29.305216 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1170 bytes} [Fri Sep 9 21:05:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:29.324528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d82077d3-fa99-4a34-88ee-891971e36b43 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17cd8b0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:29.461694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d82077d3-fa99-4a34-88ee-891971e36b43 tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.148275 Sep 09 21:05:29.462598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 12/24] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Sep 9 21:05:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:29.480045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1c77c14f-16a4-48de-bc0d-bc293e29491a tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17cae50>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:29.556055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:05:29.557974 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:05:29.559001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:05:29.559614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:05:29.560279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:05:29.617837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:29.627654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:29.627654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:29.627654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:29.627654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:29.628270 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:29.690119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1c77c14f-16a4-48de-bc0d-bc293e29491a tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216023 Sep 09 21:05:29.691010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1188 bytes} [Fri Sep 9 21:05:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:05:29.717795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1cc1881d-5d68-4f8d-8b41-9d048360758a tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] Calling method '.version_select at 0x7fa1d17d13a0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:29.727370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for project 25acf91bdf524474b03d44271d08fba6. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:29.743603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for user c764d9778ef74b709cedbccabac37af0 and project 25acf91bdf524474b03d44271d08fba6. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:29.774905 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:05:29.781472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:05:29.920378 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1cc1881d-5d68-4f8d-8b41-9d048360758a tempest-VolumesTestJSON-356761789 tempest-VolumesTestJSON-356761789-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.208515 Sep 09 21:05:29.920942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1155 bytes} [Fri Sep 9 21:05:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:30.076139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-35ae9d0e-e299-4a2e-a9d6-b73bd9e955a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.247196 Sep 09 21:05:30.080527 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 13/27] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:05:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:05:30.095837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-92d3885f-74e9-41c0-826c-b02695c29a4e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:30.097184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-92d3885f-74e9-41c0-826c-b02695c29a4e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:30.348875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-92d3885f-74e9-41c0-826c-b02695c29a4e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:30.432890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-92d3885f-74e9-41c0-826c-b02695c29a4e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1221 microversion: 2.1 time: 0.308483 Sep 09 21:05:30.432890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:30 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1221 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:30.902593 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-914082739", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:31.018371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] validate_networks() for [('8868cdd0-53b5-4cee-ad5d-e353c07fbfb2', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:05:32.762844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:05:32.764093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:05:32.764887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:05:32.765447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:05:32.766529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:05:32.786516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:32.787008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:32.787445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:32.788228 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:32.805344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:32.814588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:32.894892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for project 25acf91bdf524474b03d44271d08fba6. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:32.923317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for user c764d9778ef74b709cedbccabac37af0 and project 25acf91bdf524474b03d44271d08fba6. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:32.971182 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:05:32.973717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:05:33.226892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-34123628-ba4a-4334-9258-c403746a6d5d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.328807 Sep 09 21:05:33.232576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 14/29] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:05:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:05:33.242307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3301c4eb-ab21-4948-aff7-3f4736d5315a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:33.243011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3301c4eb-ab21-4948-aff7-3f4736d5315a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:33.702567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3301c4eb-ab21-4948-aff7-3f4736d5315a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:33.718654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3301c4eb-ab21-4948-aff7-3f4736d5315a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1221 microversion: 2.1 time: 0.475915 Sep 09 21:05:33.720314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 16/30] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:33 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1221 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:34.388273 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e0ba99e6-f82a-4162-9bbc-72c4725d4884 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'create', calling method: .version_select at 0x7fa1d0e63670>, body: {"keypair": {"name": "tempest-keypair-720501414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKH57ccbPHrdzN6txl+9QtogbuvY45J39bKPh67TcvkYS/wSy5StCzcBBYCS3nyaDCJBBxz5JuMqvNGXj+4d9zPQpLOoTP1HINuuc6wSxO+WgWkz0S7JicgT1LGjHtUBw=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:34.416984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-e0ba99e6-f82a-4162-9bbc-72c4725d4884 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:34.422570 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-e0ba99e6-f82a-4162-9bbc-72c4725d4884 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for user 710e49db188845bbae5a183c6657e07f and project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:34.604349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e0ba99e6-f82a-4162-9bbc-72c4725d4884 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.985690 Sep 09 21:05:34.604349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 15/31] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Sep 9 21:05:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 988 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 21:05:34.745204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4cf8be77-de58-41b8-83b4-6a659e7bea1d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:34.746551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4cf8be77-de58-41b8-83b4-6a659e7bea1d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:34.967931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4cf8be77-de58-41b8-83b4-6a659e7bea1d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:34.980058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4cf8be77-de58-41b8-83b4-6a659e7bea1d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1221 microversion: 2.1 time: 0.239204 Sep 09 21:05:34.985502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:34 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1221 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:35.187889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-32991388", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "networks": [{"uuid": "93657151-9a85-404c-89fc-4e2902328a0b"}]}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:35.291826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] validate_networks() for [('93657151-9a85-404c-89fc-4e2902328a0b', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:05:36.272972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:05:36.273604 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:05:36.273859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:05:36.274271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:05:36.274679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:05:36.295506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:36.296428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:36.296858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:36.297608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:36.298033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:36.298451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:36.339940 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Getting quotas for project 46978366f11c4af79a9e9ad6ff2e5e05. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:36.348687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Getting quotas for user 83e9308215e94c5e9e615be1f2a113b1 and project 46978366f11c4af79a9e9ad6ff2e5e05. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:36.377339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:05:36.380008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:05:36.388649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d0f23353-922a-486d-a61f-0dbb49bc48b3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: .version_select at 0x7fa1d1797940>, body: {"keypair": {"name": "tempest-keypair-654615978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfnPIOGNNAqkvUOpIC+Vk53InO7oInVIXVeCWQS3sB5QRuhtwpO/8YEgiE189YKDKWl9/lV7vGjXNe3bM88syjXJpL5yZcHzlgqUD4M7uUbvW/DVE/Ka6ZlDDdS7dsqnQ=="}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:36.523345 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-d0f23353-922a-486d-a61f-0dbb49bc48b3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:36.544780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-d0f23353-922a-486d-a61f-0dbb49bc48b3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for user e3ef96f764244e5893f16a74d4169edb and project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:36.706173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d0f23353-922a-486d-a61f-0dbb49bc48b3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.074372 Sep 09 21:05:36.710843 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 18/33] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:05:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:36.717454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:36.718090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:36.768535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b96eff61-210e-4ba5-9cc6-2b2f4e25ca1a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714002 Sep 09 21:05:36.797505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 16/34] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 21:05:36.836251 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-db7feff4-27b7-4b01-9318-f528d99d2c18 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:36.842125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-db7feff4-27b7-4b01-9318-f528d99d2c18 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:36.849641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:36.855959 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:36.857643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:36.858411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:36.858877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:36.859310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:37.086352 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-db7feff4-27b7-4b01-9318-f528d99d2c18 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:37.138173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-db7feff4-27b7-4b01-9318-f528d99d2c18 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1213 microversion: 2.1 time: 0.341327 Sep 09 21:05:37.143694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 17/35] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:36 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:37.410823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:37.429625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1c7d44f3-68ca-4159-875c-628817582db3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1273 microversion: 2.1 time: 0.720857 Sep 09 21:05:37.441297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 19/36] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:36 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1273 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:38.170892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8eb08a24-9809-4201-addd-8d97a6329812 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:38.172308 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8eb08a24-9809-4201-addd-8d97a6329812 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:38.359254 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8eb08a24-9809-4201-addd-8d97a6329812 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:38.371627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8eb08a24-9809-4201-addd-8d97a6329812 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1213 microversion: 2.1 time: 0.204244 Sep 09 21:05:38.374186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:38 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1213 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:38.467422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:38.468226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:38.479990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:38.480977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:38.483370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:38.484139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:38.491470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:38.491470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:38.679038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:38.711879 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bbe8271b-2c28-4f25-9c1f-ba56d07377d3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1279 microversion: 2.1 time: 0.248588 Sep 09 21:05:38.740573 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:38 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:39.406099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:39.406823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:39.433595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:39.437867 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:39.438423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:39.439286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:39.446072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:39.446821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:39.758924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:39.761451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:39.780827 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:39.786739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:39.789351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:39.794054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:39.795138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:39.798041 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:40.268352 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:40.290833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5f08f9ef-8d6d-4d91-9d73-b392bb7917fb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1265 microversion: 2.1 time: 0.891854 Sep 09 21:05:40.293284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 19/39] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:39 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1265 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:40.445431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:40.463361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1a3c35a1-dfbe-4d67-a93c-b95a31eea844 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1279 microversion: 2.1 time: 0.711012 Sep 09 21:05:40.467733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:39 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1279 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:41.317625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:41.319217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:41.331547 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:41.340771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:41.348836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:41.349988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:41.350992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:41.352775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:41.500812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:41.502688 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:41.524002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:41.524762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:41.525390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:41.526288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:41.533761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:41.534438 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:41.717436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:41.746340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9361d95b-a82b-477b-9a97-af28036d0336 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1273 microversion: 2.1 time: 0.435064 Sep 09 21:05:41.753450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 20/41] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:41 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1273 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:41.815697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:41.832379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c6b5ab9b-3809-4ea2-bded-df53fe8cedf7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1279 microversion: 2.1 time: 0.330394 Sep 09 21:05:41.836639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:41 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:42.771389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:42.772150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:42.786131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:42.788253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:42.788253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:42.788253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:42.788253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:42.792391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:42.864170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:42.864789 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:42.875748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:42.879662 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:42.880386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:42.881597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:42.883833 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:42.884289 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:43.039955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:43.066310 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c7a19ee6-b6b8-4998-a4d0-42de28102673 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1271 microversion: 2.1 time: 0.296235 Sep 09 21:05:43.070981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:42 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:43.704659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:43.721776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-61916aec-95af-4d0d-b633-69dc73435ef7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.862127 Sep 09 21:05:43.736228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 23/44] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:42 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:44.097204 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:44.097930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:44.109218 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:44.113241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:44.133139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:44.134232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:44.134903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:44.135558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:44.578140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1449175512", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5b279e2-8202-4675-bfc5-cba52dbbdbb7"}], "security_groups": [{"name": "tempest-securitygroup--411781436"}], "key_name": "tempest-keypair-720501414", "user_data": "}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:45.276631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:45.284946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2570657a-5f90-4f6c-b96c-826369973728 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 1.193985 Sep 09 21:05:45.305668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 22/45] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:44 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:45.320427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:45.320427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:45.330708 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:45.332023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:45.332707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:45.333870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:45.334729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:45.336264 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:45.774644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] validate_networks() for [('e5b279e2-8202-4675-bfc5-cba52dbbdbb7', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:05:46.303969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:46.570583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=10 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:46.963567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:46.977782 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2b59a649-e799-485f-94ba-2f939f3738d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 1.670869 Sep 09 21:05:46.979175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 23/46] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:45 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:46.988924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:46.990723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:47.007342 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=10 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:47.010855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:47.012844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:47.015161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:47.016747 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:47.017862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:47.018811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:47.576607 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:47.589940 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1701fcba-ea0e-43b2-a898-75a4806b2860 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.608966 Sep 09 21:05:47.602847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 24/47] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:46 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:48.238787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb100de-b697-4ed6-9765-b93b4e58cf88", "tag": "4ea9245f-7a66-4720-af56-8bdcc46162f8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:48.261116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:48.266646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:48.266646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:48.329050 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Creating event network-changed:4ea9245f-7a66-4720-af56-8bdcc46162f8 for instance cdb100de-b697-4ed6-9765-b93b4e58cf88 on hv-cinder-83124 Sep 09 21:05:48.333220 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 21:05:48.333669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9e0b8584-427d-41aa-9a53-42b60f0411ed req-13a42cb5-72f8-45a0-b47f-1baa2d8a2743 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 21:05:48.337289 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:48.338124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:48.340226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:48.346646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:48.348177 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:48.348793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:48.371614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=26 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:48.381195 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.compute.rpcapi [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 21:05:48.386084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] Releasing lock "compute-rpcapi-router" {{(pid=121137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 21:05:48.412495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7810b300-2f31-4551-86a9-0a2c980bb77e None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.718790 Sep 09 21:05:48.416952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 25/48] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:05:48.432129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:48.433986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:48.452411 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:48.453263 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:48.453921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:48.455932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:48.455932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:48.456452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:49.300215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:49.314478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d378d136-94d6-414b-9b2f-ca19b2c5b745 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.895010 Sep 09 21:05:49.315205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 26/49] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:48 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:49.320815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:49.321802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:49.328608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:49.329347 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:49.330097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:49.331678 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:49.332877 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:49.333803 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:50.284869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:50.289150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:05:50.291142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:05:50.291142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:05:50.291142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:05:50.291142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:05:50.302472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8bf005c0-a781-44e8-ae6c-872305705d96 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.985898 Sep 09 21:05:50.321395 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:49 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:50.329039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:50.329760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:50.330481 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:50.332280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:50.333170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:50.333778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:50.334780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1906366054", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57892a79-334e-4e74-97e6-1b8cb5d8cb77"}], "security_groups": [{"name": "tempest-securitygroup--1424737051"}], "key_name": "tempest-keypair-654615978", "user_data": "}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:50.376022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:50.412445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for user 710e49db188845bbae5a183c6657e07f and project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:50.454339 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:05:50.466016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:05:50.620064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] validate_networks() for [('57892a79-334e-4e74-97e6-1b8cb5d8cb77', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:05:50.700992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f9220b80-b890-46d7-a78a-6f2b7b296073 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.128250 Sep 09 21:05:50.710327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 24/51] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Sep 9 21:05:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 6139 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 09 21:05:50.728519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:50.729169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:50.775641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:50.780237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:50.780237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:50.780237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:50.780237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:50.790016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:51.789227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:51.797216 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a7fe5b01-1298-4ab1-8695-e981aaeae841 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 1.085004 Sep 09 21:05:51.798021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 25/52] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:50 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:51.810052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e49d1f-fff6-4f7f-9659-e49238a5bcde", "tag": "866a955a-0fc1-4fec-8c0f-a92a0f9f0d1d"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:51.855259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:51.855754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:51.856408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:51.899119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Creating event network-changed:866a955a-0fc1-4fec-8c0f-a92a0f9f0d1d for instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde on hv-cinder-83124 Sep 09 21:05:51.899956 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121136) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 21:05:51.910430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bac4690b-5c82-4001-b0ba-ef2213740ce3 req-4a2fdc41-1b6b-40cb-9220-9eb2c87f0006 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121136) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 21:05:51.926011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:51.928366 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:51.929761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:51.932529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:51.933658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:51.933658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:51.952580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.compute.rpcapi [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 21:05:51.953775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] Releasing lock "compute-rpcapi-router" {{(pid=121136) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 21:05:51.995282 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-03a7d603-60c9-4d19-af68-6321b0f5de97 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195725 Sep 09 21:05:51.995975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 26/53] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:52.005569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5afb7ad5-0348-4aac-bc3d-0fd4eb66cc73 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:52.014007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5afb7ad5-0348-4aac-bc3d-0fd4eb66cc73 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:52.143662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:05:52.145085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:05:52.146522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:05:52.147183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:05:52.147927 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:05:52.164147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.165170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.165962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:52.167051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.167726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.168662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:52.186308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5afb7ad5-0348-4aac-bc3d-0fd4eb66cc73 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:52.200278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5afb7ad5-0348-4aac-bc3d-0fd4eb66cc73 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:52.203848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5afb7ad5-0348-4aac-bc3d-0fd4eb66cc73 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:52.208382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5afb7ad5-0348-4aac-bc3d-0fd4eb66cc73 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1281 microversion: 2.20 time: 0.208283 Sep 09 21:05:52.209513 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 27/54] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:51 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1281 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:05:52.252841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:05:52.261233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for user e3ef96f764244e5893f16a74d4169edb and project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:05:52.337419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:05:52.342018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:05:52.514286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-71474272-0e90-476b-97b0-c79fd5972bcb req-7d9fd385-000d-4778-ac78-31cbb831dfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30c2af5-2694-4833-b3d2-f0a5393befbf", "tag": "775e8203-a412-4b32-aedc-6a82490a4126"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:05:52.533398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-71474272-0e90-476b-97b0-c79fd5972bcb req-7d9fd385-000d-4778-ac78-31cbb831dfa0 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.533398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-71474272-0e90-476b-97b0-c79fd5972bcb req-7d9fd385-000d-4778-ac78-31cbb831dfa0 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.533398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-71474272-0e90-476b-97b0-c79fd5972bcb req-7d9fd385-000d-4778-ac78-31cbb831dfa0 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:52.544923 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-71474272-0e90-476b-97b0-c79fd5972bcb req-7d9fd385-000d-4778-ac78-31cbb831dfa0 service nova] Creating event network-changed:775e8203-a412-4b32-aedc-6a82490a4126 for instance c30c2af5-2694-4833-b3d2-f0a5393befbf on hv-cinder-83124 Sep 09 21:05:52.550663 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-71474272-0e90-476b-97b0-c79fd5972bcb req-7d9fd385-000d-4778-ac78-31cbb831dfa0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339826 Sep 09 21:05:52.552064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 28/55] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:05:52.560019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:52.562835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:52.568823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.569884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.570906 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:52.572267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.572950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.573548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:52.638946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a4a6bf28-b7ed-4bef-a550-485757986967 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.316055 Sep 09 21:05:52.647859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 28/56] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:05:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:05:52.654676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ba4070a3-c1cc-484a-a480-99342f2235b4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:52.656566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ba4070a3-c1cc-484a-a480-99342f2235b4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:52.846938 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ba4070a3-c1cc-484a-a480-99342f2235b4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:52.854521 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ba4070a3-c1cc-484a-a480-99342f2235b4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1237 microversion: 2.1 time: 0.205295 Sep 09 21:05:52.857603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 29/57] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:52 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:52.864640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:52.870101 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:52.879860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.893555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.894428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:52.897071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:52.898348 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:52.900781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:53.155901 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:53.170052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dc98e50f-ec22-47d9-9b82-d3d14b4e6c73 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.615396 Sep 09 21:05:53.173139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 29/58] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:52 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:53.240115 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:53.241602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:53.253514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:53.256133 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:53.259066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:53.262100 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:53.263584 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:53.264316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:53.489321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:53.493349 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:53.499401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e065b545-7f11-44f2-bfcc-20f4ce8432b5 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.640337 Sep 09 21:05:53.499970 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:52 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:53.525409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:53.527398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:53.528808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e9028ad0-835d-4af3-85f2-54c4cdfa3fa4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1277 microversion: 2.20 time: 0.293861 Sep 09 21:05:53.542006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 30/60] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:53 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:05:53.929639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fc61f9c5-a635-444b-9c04-f55be91aa214 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:53.929639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fc61f9c5-a635-444b-9c04-f55be91aa214 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:53.939623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fc61f9c5-a635-444b-9c04-f55be91aa214 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:53.946629 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fc61f9c5-a635-444b-9c04-f55be91aa214 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1237 microversion: 2.1 time: 0.068848 Sep 09 21:05:53.947186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 31/61] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:53 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:54.201179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:54.201800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:54.208343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:54.233093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:54.233093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:54.233093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:54.233093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:54.233458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:54.357180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:54.365476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c44c6060-f250-4b60-bb53-ccdc33f2e6dd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.168490 Sep 09 21:05:54.366066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:54 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:54.523389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:54.523969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:54.530026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:54.530500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:54.530929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:54.531614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:54.532055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:54.532488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:54.574924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:54.575904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:54.582063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:54.582549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:54.582985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:54.583685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:54.584160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:54.584583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:54.663160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:54.671533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:54.673027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:54.674130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-177b84e0-7ff6-4136-ac01-c9cb5261de96 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.107186 Sep 09 21:05:54.674693 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 32/63] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:54 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:05:54.684268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:54.692257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9ae8df76-8301-4d7f-a10c-5ab686b85b0a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.173388 Sep 09 21:05:54.692816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 32/64] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:54 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:54.971978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a134f530-1b0a-41ac-9380-55ba11cc8259 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:54.972856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a134f530-1b0a-41ac-9380-55ba11cc8259 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:55.048626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a134f530-1b0a-41ac-9380-55ba11cc8259 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:55.057645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a134f530-1b0a-41ac-9380-55ba11cc8259 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1237 microversion: 2.1 time: 0.090400 Sep 09 21:05:55.059694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:54 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:55.388287 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:55.388898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:55.395242 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:55.395894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:55.396357 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:55.397551 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:55.398024 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:55.398516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:55.561366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:55.570285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f0709c51-d69d-44ec-81e5-a94237b31040 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.185852 Sep 09 21:05:55.571067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:55 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:55.699421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:55.700040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:55.706194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:55.706676 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:55.707115 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:55.707797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:55.708283 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:55.711250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:55.715795 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:55.716574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:55.722657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:55.723156 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:55.723685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:55.724319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:55.724777 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:55.725737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:55.810320 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:55.820745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:55.822390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:55.823691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0ff721e1-bb2e-432d-872f-92b346a2f0f8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.128062 Sep 09 21:05:55.824637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:55 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:05:55.881699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:55.890848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b6e9de4d-abe3-4714-b0eb-f7cf5c86ac2d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.179772 Sep 09 21:05:55.891619 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 34/68] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:55 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:56.083956 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:56.085147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:56.092709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.093207 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.096900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.096900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.096900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.096900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.157055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:56.165046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5273ce60-8334-4ddb-993b-e8c1743c7fc3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1241 microversion: 2.1 time: 0.084844 Sep 09 21:05:56.165698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:56 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:56.594635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:56.595242 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:56.600941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.601418 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.601846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.602528 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.602972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.603393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.735723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:56.746850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c9fcc85d-7d7e-42ac-bb48-35fce587f55b tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.155686 Sep 09 21:05:56.748098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:56 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:56.850620 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:56.851659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:56.860742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.861933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.861933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.862619 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.863070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.863682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.914071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:56.914900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:56.920923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.921487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.921992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.922698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:56.923152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:56.923574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:56.928019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=91 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:56.930925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:56.939671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:56.942230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:56.942826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-da7e0401-39c8-4dab-9efd-dd8792a8ae0b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.097549 Sep 09 21:05:56.943385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 36/71] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:56 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:05:57.057317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:57.065840 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-849a37e7-db33-49f6-ad4e-742f14184ba1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.155761 Sep 09 21:05:57.066408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 36/72] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:56 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:05:57.186723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:57.187372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:57.193269 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:57.194645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:57.195151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:57.196093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:57.196717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:57.197356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:57.262233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:57.270479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e7204486-18e4-4fd5-8ea0-c6d745454ab8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1241 microversion: 2.1 time: 0.087537 Sep 09 21:05:57.283604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 37/73] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:57 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:57.774968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:57.775591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:57.787173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:57.787713 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:57.789067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:57.789927 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:57.790464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:57.790885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:57.947597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:57.956357 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7f2d6ac5-c39e-4cee-b4a5-96ce7d7b7895 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.186331 Sep 09 21:05:57.957170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 37/74] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:57 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:57.968870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:57.973979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:57.973979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:57.977352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:57.977868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:57.978299 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:57.978998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:57.979445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:57.979888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:57.984143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=93 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:58.043230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:58.051184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:58.052652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:58.053770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-667eb3b8-2933-433a-9e57-947b9cf81d2f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.089290 Sep 09 21:05:58.054376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 38/75] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:57 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:05:58.089731 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:58.090413 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:58.096601 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:58.097107 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:58.097536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:58.098231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:58.098671 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:58.099088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:58.233898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:58.241530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6e9fd4fe-2af6-4859-b85e-f641b8e5a36e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.155684 Sep 09 21:05:58.242125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:58 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:58.293020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:58.293684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:58.299416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:58.299900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:58.300367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:58.301259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:58.301706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:58.302312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:58.366420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:58.373892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-abe9e35b-bafd-41d7-9625-c1bfb1c9fde1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1241 microversion: 2.1 time: 0.084730 Sep 09 21:05:58.377095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 39/77] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:58 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:58.996909 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:59.000241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:59.011652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.012241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.012893 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.013621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.014151 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.014635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.082838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:59.083867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:59.092869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.102841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.102841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.102841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.102841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.103257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.328968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:59.346170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:59.349270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:59.350909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3a8902dc-20f1-45af-a69f-5ad8f575ee41 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.274920 Sep 09 21:05:59.368587 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 40/78] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:05:59 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:05:59.373630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:59.374278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:59.382809 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.383315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.383751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.384482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.385026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.385454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.454123 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:59.463413 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-45e283d9-234d-4b1a-b716-e72835bd204d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.487654 Sep 09 21:05:59.464091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:58 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:59.469991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:05:59.470755 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:05:59.479385 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.480129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.480920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.481781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:05:59.482595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:05:59.486344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:05:59.557494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:59.565279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b3c7f028-b9aa-48d7-a35f-75389036d2e1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1241 microversion: 2.1 time: 0.100203 Sep 09 21:05:59.565844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 40/80] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:59 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:05:59.583370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:05:59.590984 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e0763e39-506e-4345-bb73-967bd6a9d42f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.227284 Sep 09 21:05:59.591553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 41/81] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:05:59 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:00.378374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:00.378969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:00.385795 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.386414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.387016 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.387745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.388237 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.388681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.453072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:00.461531 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:00.462956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:00.464047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-61d11515-61f5-4cd0-baff-d235ab3b202d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.089895 Sep 09 21:06:00.464826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 41/82] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:00 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:00.486905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:00.490147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:00.494507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.494992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.495473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.496446 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.497491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.497990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.589854 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:00.590467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:00.597015 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.597312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.597746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.598449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.598899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.599326 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.638471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:00.646488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-31ec9df7-842b-4d19-b4ab-2d21db4e9ac6 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.163421 Sep 09 21:06:00.662056 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 42/83] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:00 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:00.667062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:00.667795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:00.668436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:00.674813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7cb9bee8-8d4a-4dc9-b94c-460cd103d56a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1241 microversion: 2.1 time: 0.090317 Sep 09 21:06:00.676000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.676596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.677035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.677732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:00.678716 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:00.679145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:00.682465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 42/84] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:00 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:06:00.823679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:00.834115 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4c9bc1b9-b9ed-4194-b486-1bfb81fc65ae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.170902 Sep 09 21:06:00.835010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:00 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:01.490476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:01.491092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:01.501341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.501821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.502248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.503036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.503486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.504120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.566412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:01.574494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:01.576250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:01.577455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-57df6a87-da04-4d38-8737-ca1757b45445 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1333 microversion: 2.20 time: 0.090787 Sep 09 21:06:01.585258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 43/86] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:01 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:01.669485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:01.670143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:01.675988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.676662 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.677436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.678159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.678650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.679069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.699126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:01.699850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:01.705903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.706382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.706812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.707500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.707971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.708407 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.787763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:01.802007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b3947726-fcbf-469a-a96d-7a4d41814933 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1241 microversion: 2.1 time: 0.106635 Sep 09 21:06:01.816251 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:01 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:06:01.863521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:01.865749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:01.866372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:01.871868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-23e71bb5-d119-4454-b0dc-2a8e7a6c09ea tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.206165 Sep 09 21:06:01.872225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.872714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.873146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:01.873969 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 44/88] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:01 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:01.875392 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:01.876012 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:01.876532 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:02.072656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:02.082515 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e449dff7-1c92-4e4d-801d-f3ebfb60e7a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.220726 Sep 09 21:06:02.083015 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:01 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:06:02.603487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:02.604482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:02.606461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=4 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:02.611221 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:02.611703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:02.612165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:02.612856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:02.613308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:02.613726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:02.673555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:02.682309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:02.683755 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:02.684870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9b877303-ef65-4feb-a09f-9baeca801940 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1341 microversion: 2.20 time: 0.086138 Sep 09 21:06:02.685556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 45/90] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:02 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1341 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:02.829977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:02.830689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:02.832414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=4 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:02.837732 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:02.838217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:02.840169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:02.840169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:02.840169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:02.840393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:02.901370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:02.903002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:02.905574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:02.913754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1e3fa581-6737-4791-a829-cc404dd990d0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.087948 Sep 09 21:06:02.914349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 46/91] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:02 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:02.929065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:02.929688 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:02.930138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:02.931301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:02.931762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:02.932230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:03.084275 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:03.094318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6e1bb687-abd4-41b4-852d-b0a476e2b400 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.199199 Sep 09 21:06:03.095380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 46/92] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:02 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:03.111150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:03.111767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:03.118566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:03.119081 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:03.119507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:03.120227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:03.120672 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:03.121087 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:03.310509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:03.318297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-948e4a54-d10e-4172-b318-9ee7570edf19 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.212346 Sep 09 21:06:03.319823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 47/93] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:03 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:03.712001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:03.712614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:03.718891 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:03.719443 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:03.719933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:03.720836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:03.721284 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:03.721698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:03.782255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:03.793860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:03.795544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:03.800253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-063df1d9-61f7-4fbc-94ed-b71f76023356 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1341 microversion: 2.20 time: 0.089879 Sep 09 21:06:03.800253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 47/94] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:03 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:03.943227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:03.944558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:03.950602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=10 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:03.952355 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:03.952841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:03.953275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:03.953974 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:03.954552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:03.955154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.019549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:04.027778 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a92c5534-f539-44f7-b4a9-0da269526dbb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.089679 Sep 09 21:06:04.028294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 48/95] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:03 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:04.117844 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:04.118473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:04.124308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:04.124775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:04.125210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.125898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:04.126357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:04.126807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.258575 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:04.267705 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f8cf8487-260c-4297-83b5-1d4e7578a38d tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.153462 Sep 09 21:06:04.268380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 48/96] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:04 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:04.342662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:04.343268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:04.349589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:04.350071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:04.350507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.351187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:04.351639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:04.352062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.484896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:04.494598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0ce9838f-9ba4-4a23-9bbf-6f34fa4f8830 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.155113 Sep 09 21:06:04.494833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 49/97] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:04 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:04.822306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:04.822885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:04.828919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:04.829391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:04.829816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.830496 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:04.830937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:04.831351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:04.915365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:04.923622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:04.925167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:04.926262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e8bb6e80-5999-41b0-b33e-79f72e979555 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1341 microversion: 2.20 time: 0.107912 Sep 09 21:06:04.926818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 49/98] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:04 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1341 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:05.050318 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:05.050925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:05.057506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.057992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.058409 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.059102 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.059553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.059971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.145123 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:05.155575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4e1fe382-30fb-4388-a853-7acc4099e35e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.109009 Sep 09 21:06:05.156627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:05 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:05.291135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:05.292033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:05.297767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=10 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:05.299775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.300458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.300899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.301966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.302423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.302884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.438494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:05.446617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-096bc559-b94f-460b-b17a-ea58b8231f40 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.160323 Sep 09 21:06:05.447212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 50/100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:05 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:05.517935 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:05.518656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:05.525424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.525905 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.526340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.527266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.527726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.528179 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.656964 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:05.664442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ae691202-06ee-4a48-b970-42a652f5d8fa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.150374 Sep 09 21:06:05.664997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 51/101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:05 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:05.954486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:05.955660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:05.962387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.963087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.963595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:05.964383 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:05.964986 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:05.965447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.036411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:06.044542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:06.046342 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:06.047504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-266ca553-573d-4c2f-82af-08dd7dd58ef5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1351 microversion: 2.20 time: 0.098286 Sep 09 21:06:06.048479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 51/102] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:05 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:06.179448 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:06.180208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:06.186470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:06.186973 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:06.187390 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.188104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:06.188558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:06.188974 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.268004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:06.270511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:06.277992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3dcbbc61-1801-499c-a031-ec5a7ca8a796 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.102847 Sep 09 21:06:06.279077 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 52/103] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:06 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:06.469784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:06.470488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:06.477106 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:06.477586 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:06.478019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.478719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:06.479161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:06.479581 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.610769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:06.618396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8b690bde-9c33-4052-bc12-6850b03d0f68 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.152350 Sep 09 21:06:06.618967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 52/104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:06 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:06.690295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:06.692562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:06.696917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:06.697399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:06.697862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.698691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:06.699126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:06.699642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:06.833687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:06.843752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6b5f07ec-c1b9-445a-ac75-1093903afa85 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.160718 Sep 09 21:06:06.844352 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 53/105] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:06 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:07.073932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:07.074622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:07.081095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.081647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.082085 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.082784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.083237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.083661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.148600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:07.156726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:07.158168 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:07.159315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e7619ecc-8c33-48f1-852d-4a35af0c4b6a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1351 microversion: 2.20 time: 0.089289 Sep 09 21:06:07.159862 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 53/106] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:07 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:07.308947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:07.309485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:07.327609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.327609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.327609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.327609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.327875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.336225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.401761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:07.412478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-59f52bed-4693-4fd1-b153-ae5de6d65b6e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.108887 Sep 09 21:06:07.424436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 54/107] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:07 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:07.643958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:07.644242 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:07.655217 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.655706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.656169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.656867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.657493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.657919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.850839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:07.854440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:07.862884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1ff7d728-75e9-4067-ab2a-c6e4d2be36ae tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.225458 Sep 09 21:06:07.863743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 54/108] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:07 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:07.868859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:07.870099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:07.877836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.878330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.878766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:07.879471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:07.879925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:07.880372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:08.015245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:08.022889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9c2837bb-b30a-44af-a267-06de8d12b4f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.158417 Sep 09 21:06:08.023437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 55/109] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:07 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:08.186100 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:08.186100 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:08.197213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:08.197705 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:08.198133 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:08.201765 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:08.202239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:08.202675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:08.294227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:08.303145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:08.304691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:08.305789 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-04a0a844-2336-4f3a-ac78-bd876c3d30be tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1351 microversion: 2.20 time: 0.125864 Sep 09 21:06:08.317498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 55/110] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:08 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:08.433365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:08.433979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:08.442108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:08.444286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:08.445282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:08.446491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:08.447240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:08.447856 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:08.519547 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:08.528668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9190f04f-a14a-4f80-af11-63d9298a140c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.099360 Sep 09 21:06:08.529458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 56/111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:08 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:08.890379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:08.890982 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:08.896916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:08.897407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:08.897837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:08.898524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:08.898967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:08.899382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.046341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:09.046955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:09.055064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:09.056662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:09.060701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.065299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:09.065299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:09.065299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.069898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:09.081316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1283beff-814e-462e-94c5-64cf7e809245 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.195514 Sep 09 21:06:09.082066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 56/112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:08 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:09.227762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:09.238043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9af2f316-4e88-449e-8fa0-9c888316f3e1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.196146 Sep 09 21:06:09.241478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 57/113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:09 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:09.344601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:09.345288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:09.351998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:09.352651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:09.353074 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.354337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:09.354981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:09.355569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.428643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:09.442464 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:09.444489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:09.446072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0b6da029-d472-4458-9760-6962e7a6322e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1351 microversion: 2.20 time: 0.107939 Sep 09 21:06:09.456355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 57/114] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:09 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:09.551117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:09.551798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:09.561796 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:09.562313 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:09.562779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.563475 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:09.566116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:09.566583 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:09.712847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:09.723668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e7a301d5-4752-46f5-bae5-8fd03bcd38f7 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1289 microversion: 2.1 time: 0.176684 Sep 09 21:06:09.729246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 58/115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:09 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:10.105140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:10.106096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:10.113178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.113967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.114393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.115087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.115564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.116182 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.316577 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:10.316577 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-696f43e0-f539-4f15-933a-c5aa4642ab79 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.215405 Sep 09 21:06:10.335624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:10 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:10.349277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:10.349917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:10.358153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.358854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.359442 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.360523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.361124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.361681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.673935 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-29d2f012-360e-4502-bd2a-a2f29d4f7fcb req-a7af984e-271c-48f1-a8f0-01e5c650f841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb100de-b697-4ed6-9765-b93b4e58cf88", "name": "network-vif-plugged", "status": "completed", "tag": "4ea9245f-7a66-4720-af56-8bdcc46162f8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:10.678633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:10.686511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-29d2f012-360e-4502-bd2a-a2f29d4f7fcb req-a7af984e-271c-48f1-a8f0-01e5c650f841 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.687174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-29d2f012-360e-4502-bd2a-a2f29d4f7fcb req-a7af984e-271c-48f1-a8f0-01e5c650f841 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.687598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-29d2f012-360e-4502-bd2a-a2f29d4f7fcb req-a7af984e-271c-48f1-a8f0-01e5c650f841 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.702729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-29d2f012-360e-4502-bd2a-a2f29d4f7fcb req-a7af984e-271c-48f1-a8f0-01e5c650f841 service nova] Creating event network-vif-plugged:4ea9245f-7a66-4720-af56-8bdcc46162f8 for instance cdb100de-b697-4ed6-9765-b93b4e58cf88 on hv-cinder-83124 Sep 09 21:06:10.705159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4a292f47-cd12-4195-81a9-c0cc8c89f944 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.368329 Sep 09 21:06:10.709743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 59/117] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:10 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:10.711002 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-29d2f012-360e-4502-bd2a-a2f29d4f7fcb req-a7af984e-271c-48f1-a8f0-01e5c650f841 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.489789 Sep 09 21:06:10.716721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 59/118] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:10.725351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:10.726155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:10.742069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.744483 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.745152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.746208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.746977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.748250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.751651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:10.752533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:10.763811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.765597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.766261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.771486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:10.771486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:10.771486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:10.894205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:10.905610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-83deebb1-ac14-4977-8f88-146545178299 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1307 microversion: 2.1 time: 0.158376 Sep 09 21:06:10.913224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 60/119] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:10 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:10.966104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:10.986547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:10.988026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:10.989219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-63f3fd05-4c04-420f-8bea-55a4e3348e5c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1339 microversion: 2.20 time: 0.276794 Sep 09 21:06:10.989778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 60/120] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:10 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1339 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:11.339767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:11.342524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:11.351642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:11.352045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:11.352492 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:11.353200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:11.353645 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:11.354102 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:11.732039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:11.732671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:11.741231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:11.743515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:11.746274 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:11.746890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:11.748858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:11.752171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:11.754808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:11.767711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-09262540-b6f6-458b-b405-9116b4645ecb tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.427274 Sep 09 21:06:11.770747 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 61/121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:11 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:11.943068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:11.943068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:11.958556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:11.959085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:11.966462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:11.969667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:11.971681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:11.972275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.200170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:12.216697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e31666b9-dc62-44fa-9b6f-2ace2cad3f00 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1295 microversion: 2.1 time: 0.279195 Sep 09 21:06:12.217275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 62/122] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:11 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1295 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:06:12.221992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:12.222801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:12.229344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:12.230035 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:12.230638 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.232158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:12.232963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:12.233623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.429972 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:12.447511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1f172d7a-40cb-4179-b262-a697372a8248 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.717384 Sep 09 21:06:12.448795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 61/123] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:11 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:12.507073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:12.515909 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:12.517816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:12.519350 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7300f3d2-a9d9-46f9-bf91-8f0cead11d9e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.300943 Sep 09 21:06:12.520304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 63/124] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:12 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:12.728298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-d0a052e0-a4cf-4123-9dc0-29b07c7df5be req-4e98fc0c-c9b7-4f50-bb78-43807abefb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30c2af5-2694-4833-b3d2-f0a5393befbf", "name": "network-vif-plugged", "status": "completed", "tag": "775e8203-a412-4b32-aedc-6a82490a4126"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:12.738459 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-d0a052e0-a4cf-4123-9dc0-29b07c7df5be req-4e98fc0c-c9b7-4f50-bb78-43807abefb78 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:12.739038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-d0a052e0-a4cf-4123-9dc0-29b07c7df5be req-4e98fc0c-c9b7-4f50-bb78-43807abefb78 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:12.739400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-d0a052e0-a4cf-4123-9dc0-29b07c7df5be req-4e98fc0c-c9b7-4f50-bb78-43807abefb78 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.752312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-d0a052e0-a4cf-4123-9dc0-29b07c7df5be req-4e98fc0c-c9b7-4f50-bb78-43807abefb78 service nova] Creating event network-vif-plugged:775e8203-a412-4b32-aedc-6a82490a4126 for instance c30c2af5-2694-4833-b3d2-f0a5393befbf on hv-cinder-83124 Sep 09 21:06:12.767532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-d0a052e0-a4cf-4123-9dc0-29b07c7df5be req-4e98fc0c-c9b7-4f50-bb78-43807abefb78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Sep 09 21:06:12.772481 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 62/125] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:12.798067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-15b2f304-c091-41d3-9f67-40d5caaf9ee3 req-6c36955c-877d-48da-86e4-d38b376d9b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:12.807286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:12.809596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-15b2f304-c091-41d3-9f67-40d5caaf9ee3 req-6c36955c-877d-48da-86e4-d38b376d9b5c service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:12.810270 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-15b2f304-c091-41d3-9f67-40d5caaf9ee3 req-6c36955c-877d-48da-86e4-d38b376d9b5c service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:12.810843 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-15b2f304-c091-41d3-9f67-40d5caaf9ee3 req-6c36955c-877d-48da-86e4-d38b376d9b5c service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.811078 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:12.812271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:12.823367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:12.823971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:12.824536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-15b2f304-c091-41d3-9f67-40d5caaf9ee3 req-6c36955c-877d-48da-86e4-d38b376d9b5c service nova] Creating event network-changed:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:06:12.825080 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.825803 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:12.828023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:12.830765 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:12.830921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-15b2f304-c091-41d3-9f67-40d5caaf9ee3 req-6c36955c-877d-48da-86e4-d38b376d9b5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037395 Sep 09 21:06:12.831760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 64/126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:13.048768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:13.056457 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-28225cf6-924b-479e-bf36-d9fcb48084b2 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.253474 Sep 09 21:06:13.057027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 63/127] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:12 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:13.242643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:13.243218 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:13.249945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:13.250779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:13.251086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:13.251918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:13.252621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:13.253237 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:13.471265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:13.472004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:13.478517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:13.479168 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:13.481749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:13.481749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:13.481749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:13.481749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:13.506726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:13.516364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ace14149-c029-4ed4-bd40-301215d3177d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.278527 Sep 09 21:06:13.516937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 65/128] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:13 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:13.555248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:13.555857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:13.585835 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:13.586329 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:13.586781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:13.587463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:13.587910 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:13.610143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:13.816409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:13.828511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5f1af5c9-0af7-4dd8-88db-ee4017b332c8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.361087 Sep 09 21:06:13.830507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 64/129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:13 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:13.889839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:13.899915 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:13.901383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:13.902495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3462967f-bafe-4204-95ca-eab6f53b3a6f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.355055 Sep 09 21:06:13.909414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 66/130] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:13 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:06:14.080433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:14.081044 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:14.087578 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.088089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.088555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.089257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.089715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.090153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.291933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:14.305813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-67fa0301-312f-4274-8d71-2f49f1a3b3f1 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.229541 Sep 09 21:06:14.308129 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 65/131] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:14 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:14.499543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-68a4bc88-e385-4902-8b04-683f997104f8 req-a727f5db-ec4c-4e51-9e69-6a4cc20fbd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f14bf7b-dd56-44e0-bd6a-cd546c3956ca", "tag": "24603941-285a-42e6-adac-2398e3dbcba9"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:14.511621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-68a4bc88-e385-4902-8b04-683f997104f8 req-a727f5db-ec4c-4e51-9e69-6a4cc20fbd15 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.512014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-68a4bc88-e385-4902-8b04-683f997104f8 req-a727f5db-ec4c-4e51-9e69-6a4cc20fbd15 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.513359 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-68a4bc88-e385-4902-8b04-683f997104f8 req-a727f5db-ec4c-4e51-9e69-6a4cc20fbd15 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.526951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-68a4bc88-e385-4902-8b04-683f997104f8 req-a727f5db-ec4c-4e51-9e69-6a4cc20fbd15 service nova] Creating event network-changed:24603941-285a-42e6-adac-2398e3dbcba9 for instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca on hv-cinder-83124 Sep 09 21:06:14.532695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-68a4bc88-e385-4902-8b04-683f997104f8 req-a727f5db-ec4c-4e51-9e69-6a4cc20fbd15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037377 Sep 09 21:06:14.539846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:14.540856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:14.546869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.547359 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.547788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.548093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 67/132] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:14.548969 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.549476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.549900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.729847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:14.739826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-98f27f48-7fb8-49a9-9841-98c3845098e8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.204409 Sep 09 21:06:14.740479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 66/133] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:14 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:14.784696 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-81db3de3-99c2-4243-8caf-497ff6e40e1f req-7bd6aed5-4ba5-48bd-abc9-f1f232fe840b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e49d1f-fff6-4f7f-9659-e49238a5bcde", "name": "network-vif-plugged", "status": "completed", "tag": "866a955a-0fc1-4fec-8c0f-a92a0f9f0d1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:14.803114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-81db3de3-99c2-4243-8caf-497ff6e40e1f req-7bd6aed5-4ba5-48bd-abc9-f1f232fe840b service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.803114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-81db3de3-99c2-4243-8caf-497ff6e40e1f req-7bd6aed5-4ba5-48bd-abc9-f1f232fe840b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.803114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-81db3de3-99c2-4243-8caf-497ff6e40e1f req-7bd6aed5-4ba5-48bd-abc9-f1f232fe840b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.806151 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-81db3de3-99c2-4243-8caf-497ff6e40e1f req-7bd6aed5-4ba5-48bd-abc9-f1f232fe840b service nova] Creating event network-vif-plugged:866a955a-0fc1-4fec-8c0f-a92a0f9f0d1d for instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde on hv-cinder-83124 Sep 09 21:06:14.810951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-81db3de3-99c2-4243-8caf-497ff6e40e1f req-7bd6aed5-4ba5-48bd-abc9-f1f232fe840b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030352 Sep 09 21:06:14.811543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 68/134] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:14.855130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:14.858962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:14.870737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.870737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.870737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.870737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.871158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.871158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.939001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:14.939804 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:14.947246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.947811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.948332 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:14.949191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:14.949794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:14.950362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:15.086339 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:15.094340 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2893921c-b7c3-4b67-822e-974d29176743 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.246433 Sep 09 21:06:15.094905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 67/135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:14 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:15.132016 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:15.141974 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:15.143684 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:15.144991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4a822b94-3a43-422d-8ef0-6cfa6380c461 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.210630 Sep 09 21:06:15.146018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 69/136] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:14 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:06:15.332850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:15.333687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:15.341138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:15.341678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:15.342067 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:15.342758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:15.343206 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:15.343755 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:15.481917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:15.498568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1107292a-ba96-4c4c-80bc-593f7b98cb6a tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.166288 Sep 09 21:06:15.500425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:15 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:06:15.764124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:15.765132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:15.773046 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:15.773892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:15.774325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:15.775524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:15.776224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:15.780999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:15.993319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:16.000278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1b1713a1-9fa1-417d-a762-b6835fe177f5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.241409 Sep 09 21:06:16.013070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:15 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:16.117050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:16.117555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:16.123417 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:16.123904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:16.124369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:16.125091 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:16.125546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:16.125964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:16.171004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:16.174042 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:16.184171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:16.184845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:16.185495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:16.186206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:16.196550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:16.197065 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:16.514850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:16.525751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-02eb07cd-81fa-441d-ace6-b652c04e245d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.412477 Sep 09 21:06:16.526966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:16 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:16.533059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:16.533899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:16.566629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:16.567158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:16.577424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:16.577424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:16.577424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:16.577424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:16.611995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:16.632898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:16.635069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:16.640962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9ece49dd-0c5a-4791-b48d-2b8d45b52d70 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.472356 Sep 09 21:06:16.642428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 71/140] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:16 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:06:16.892829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:16.900648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-19414fbc-853c-4763-89fe-bb5ce37ce156 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1313 microversion: 2.1 time: 0.371833 Sep 09 21:06:16.901227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:16 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:17.028652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:17.029272 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:17.038421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.039021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.039520 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.040308 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.040768 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.041194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.046722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:17.195449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:17.203264 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c5945a46-da62-4bb8-9ec8-13b0567cb3d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.178570 Sep 09 21:06:17.204449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 72/142] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:17 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:17.548113 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:17.548813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:17.554573 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.555050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.555491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.556204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.556652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.557072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.666353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:17.666960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:17.675265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.675751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.676205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.679490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.680136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.680719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.774011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:17.783201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-20eaf940-7570-415c-86f5-ba724b885cbb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.238823 Sep 09 21:06:17.784156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:17 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:17.854365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:17.862385 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:17.863995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:17.865127 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ed071176-92ff-4722-ac19-3423ec703070 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.203282 Sep 09 21:06:17.876092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 73/144] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:17 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:17.926745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:17.927392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:17.935247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.935728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.936188 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.936988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:17.937443 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:17.937864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:17.945853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:18.105655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:18.113750 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f0b3cdae-47d6-45fa-af07-0c9ec569c7ec tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1500 microversion: 2.1 time: 0.190778 Sep 09 21:06:18.114322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 72/145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:17 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:18.228021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:18.229309 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:18.236342 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:18.237053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:18.237747 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:18.238658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:18.239443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:18.240088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:18.388033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:18.399276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-63dd42dd-a855-4ab4-a92f-d97040a5bc08 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.176175 Sep 09 21:06:18.415781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 74/146] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:18 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:18.806868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:18.807492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:18.813617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:18.814101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:18.814535 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:18.815230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:18.815677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:18.816125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:18.900228 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:18.901175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:18.908583 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:18.909076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:18.909839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:18.913121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:18.913121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:18.913121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:19.156810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:19.168410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d71a1e51-370e-4e30-b56f-4353dd12ce92 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.365624 Sep 09 21:06:19.169672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:18 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:19.205428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:19.214884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:19.216866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:19.218001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-79db06fa-697a-4dcc-8aec-0e2081e74729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.327562 Sep 09 21:06:19.218541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 75/148] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:18 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:19.422512 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:19.423184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:19.429538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:19.430019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:19.430451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:19.431137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:19.431584 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:19.432016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:19.562671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:19.570966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c24bf365-1f50-42ad-a919-9b8b76f685f9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.152251 Sep 09 21:06:19.571518 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 74/149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:19 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:20.196817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:20.198991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:20.206804 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:20.207623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:20.208343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:20.209689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:20.210217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:20.210713 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:20.246045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:20.246927 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:20.253878 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:20.254573 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:20.256758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:20.256758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:20.256758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:20.257564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:20.465530 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:20.468939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:20.470150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:20.471215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-eb316867-6e57-4d93-840a-f949dfe0b18b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.231140 Sep 09 21:06:20.471770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 75/150] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:20 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:20.480426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:20.488511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-24ccddeb-fcaf-4625-a89d-3fbcd394acd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.296949 Sep 09 21:06:20.502637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 76/151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:20 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:20.593372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:20.594029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:20.600509 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:20.601183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:20.601771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:20.602641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:20.603474 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:20.604097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:20.736734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:20.746441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-38f8f16c-970b-4890-885a-aeb1be4fad91 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.156863 Sep 09 21:06:20.747307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 76/152] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:20 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:21.195428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f0e1446-0426-4045-b8c1-c94c8d6adf11"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:21.196791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:21.204354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.205998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.206686 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.207536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.208311 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.209278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.499677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:21.500907 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:21.508643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.511022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.511022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.511390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.512233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.512876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.699230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:21.710372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:21.711873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:21.713107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0cdb0d4d-a6da-44a3-abb7-2e609fb9678a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.217744 Sep 09 21:06:21.728318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 77/153] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:21 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:21.728318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:21.728318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:21.728318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.728719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.728719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.728719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.728719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.729019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.913448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:21.921314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-377bc3a1-d143-46a9-9aab-87a58dddc5d7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1321 microversion: 2.1 time: 0.206685 Sep 09 21:06:21.921876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:21 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:21.926543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:21.927155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:21.933335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.933818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.934255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:21.934947 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:21.935411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:21.935825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:22.087248 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:22.094786 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bd7ab061-f590-48bd-9925-1cb0ae5b88cb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.171853 Sep 09 21:06:22.095356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:21 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:22.739054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:22.741058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:22.747672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:22.748483 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:22.748991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:22.756091 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:22.756678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:22.757229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:23.255422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:23.263891 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:23.265406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:23.266505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-aee75d1c-fbbe-4ed4-803c-faf2b7a726cf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.531608 Sep 09 21:06:23.267055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 80/156] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:22 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:06:23.272263 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:23.273104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:23.279108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:23.279797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:23.280522 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:23.281217 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:23.281665 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:23.282268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:23.681975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:23.696732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ec917544-4e11-4d4c-ba60-7ca86250f994 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1514 microversion: 2.1 time: 0.427277 Sep 09 21:06:23.697685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 81/157] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:23 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:23.704061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:23.704875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:23.713077 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:23.713803 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:23.715233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:23.716254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:23.719968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:23.725715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:23.960470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:23.973953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-885ff941-c797-4bc2-a767-28a23d8e3a78 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.274444 Sep 09 21:06:23.980766 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 82/158] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:23 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:23.987261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:24.010960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:24.024237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.024742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.025180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:24.025894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.026349 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.032310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:24.162446 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lazy-loading 'flavor' on Instance uuid c3e49d1f-fff6-4f7f-9659-e49238a5bcde {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:06:24.642089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-86385875-b13f-4232-a6c8-379d7f05bd0e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde/action" status: 200 len: 32 microversion: 2.1 time: 0.659857 Sep 09 21:06:24.642830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 83/159] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:06:23 2022] POST /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde/action => generated 32 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:06:24.667253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-75491e54-c5a4-4672-b326-ef19e62276b6 req-20c83119-6296-4c4e-9041-2509e22b92f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "name": "network-vif-plugged", "status": "completed", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:24.681986 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-75491e54-c5a4-4672-b326-ef19e62276b6 req-20c83119-6296-4c4e-9041-2509e22b92f9 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.683169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-75491e54-c5a4-4672-b326-ef19e62276b6 req-20c83119-6296-4c4e-9041-2509e22b92f9 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.683771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-75491e54-c5a4-4672-b326-ef19e62276b6 req-20c83119-6296-4c4e-9041-2509e22b92f9 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:24.696225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-75491e54-c5a4-4672-b326-ef19e62276b6 req-20c83119-6296-4c4e-9041-2509e22b92f9 service nova] Creating event network-vif-plugged:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:06:24.702182 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-75491e54-c5a4-4672-b326-ef19e62276b6 req-20c83119-6296-4c4e-9041-2509e22b92f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041986 Sep 09 21:06:24.721385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 84/160] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:24.721385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:24.721385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:24.732132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.732607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.733114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:24.733945 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.735330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.735938 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:24.744453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-41147ace-b044-47dd-98b1-bb47aa6ecda8 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "POST /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.555048 Sep 09 21:06:24.745306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 77/161] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:06:21 2022] POST /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf/os-volume_attachments => generated 194 bytes in 3557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:24.781541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:24.784000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:24.799922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.800718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.801339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:24.804672 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:24.806797 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:24.807944 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:25.108481 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:25.123611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:25.125795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:25.127300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-20a3074b-593f-43a4-a266-0946946e72ea tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.413513 Sep 09 21:06:25.132359 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 85/162] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:24 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:25.161045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:25.167720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:25.190010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:25.190600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:25.191580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:25.192436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:25.192968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:25.194010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:25.472334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:25.472334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4530b7a0-6f60-41d2-9d66-60bcce19eb3c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.669020 Sep 09 21:06:25.472334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 78/163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:24 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:25.473930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:25.473930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e2d0a0fe-c0dd-4fad-a9af-f293d4695789 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.322725 Sep 09 21:06:25.473930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 86/164] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:25 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:26.169689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:26.170288 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:26.179239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:26.180051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:26.180727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:26.181636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:26.182909 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:26.183622 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:26.487653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:26.490261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:26.500032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:26.500885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:26.501764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:26.504263 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:26.507092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:26.507722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:26.592931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:26.854758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:26.866850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:26.870316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:26.871884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8d17c14b-73a8-4226-8058-80dcd92850da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.706211 Sep 09 21:06:26.884595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 79/165] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:26 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:26.891692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:26.892649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:26.900465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:26.901315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:26.902056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:26.903499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:26.904207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:26.904924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:27.015668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:27.023156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bdef5b81-078f-43be-9bc1-f24dbc6d0d15 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.540282 Sep 09 21:06:27.023742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 87/166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:26 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:27.178754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:27.197885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8f6c18e0-1a43-492e-979b-27030965fa66 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.310223 Sep 09 21:06:27.218652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 80/167] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:26 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:27.899815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:27.901272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:27.904636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:27.908417 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:27.909178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:27.909764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:27.910627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:27.911230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:27.911646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:28.060621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:28.061238 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:28.067187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:28.067675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:28.071458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:28.074935 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:28.075511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:28.077297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:28.293274 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:28.305300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:28.307237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:28.308914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3bf34a60-2530-4f23-88d4-fe12e922956a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1406 microversion: 2.20 time: 0.414053 Sep 09 21:06:28.310001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 88/168] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:27 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1406 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:28.315593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:28.318813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:28.324576 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:28.325251 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:28.326075 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:28.327559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:28.328372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:28.328986 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:28.353508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:28.366625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3c762bfe-3644-4afe-9d5a-cc77695430a3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.325055 Sep 09 21:06:28.368727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 81/169] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:28 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:28.446357 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-58c66251-4f3d-479c-864a-dcc64492c2c5 req-f5c675e5-105d-44e7-ae11-92a2726775b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14bf7b-dd56-44e0-bd6a-cd546c3956ca", "name": "network-vif-plugged", "status": "completed", "tag": "24603941-285a-42e6-adac-2398e3dbcba9"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:28.477831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-58c66251-4f3d-479c-864a-dcc64492c2c5 req-f5c675e5-105d-44e7-ae11-92a2726775b5 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:28.478549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-58c66251-4f3d-479c-864a-dcc64492c2c5 req-f5c675e5-105d-44e7-ae11-92a2726775b5 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:28.478987 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-58c66251-4f3d-479c-864a-dcc64492c2c5 req-f5c675e5-105d-44e7-ae11-92a2726775b5 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:28.491726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-58c66251-4f3d-479c-864a-dcc64492c2c5 req-f5c675e5-105d-44e7-ae11-92a2726775b5 service nova] Creating event network-vif-plugged:24603941-285a-42e6-adac-2398e3dbcba9 for instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca on hv-cinder-83124 Sep 09 21:06:28.500611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-58c66251-4f3d-479c-864a-dcc64492c2c5 req-f5c675e5-105d-44e7-ae11-92a2726775b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058259 Sep 09 21:06:28.502456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 82/170] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:28.657715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:28.678022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3622d857-0c5d-46ae-9291-76c3d3dda3be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.364367 Sep 09 21:06:28.678022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 89/171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:28 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:29.339593 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:29.340323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:29.357312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.358463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.358906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.359628 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.360105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.365647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.392788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:29.394312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:29.405198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.406600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.407910 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.409148 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.409606 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.410243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.843384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:29.853886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:29.854813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-20f88a87-ca13-488b-bf34-0ca28ad485c2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.285655 Sep 09 21:06:29.854813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 90/172] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:29 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:06:29.857711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:29.857711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:29.857711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9837578b-88a9-42e9-8a79-79e53232c244 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1599 microversion: 2.20 time: 0.360648 Sep 09 21:06:29.858226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 83/173] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:06:29 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1599 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:06:29.858307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:29.858307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:29.858307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.858307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.858582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.858582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.858582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.858582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.858846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:29.858846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:29.858846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.858846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.859115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.859115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:29.859115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:29.859115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:29.891808 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-790376f0-dd72-45bd-b531-e09e5f540ce0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.170458 Sep 09 21:06:29.892728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 84/174] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Sep 9 21:06:29 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:06:30.043172 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:30.053421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1eaa0ce9-266d-4f60-9d88-6e71f0b89f60 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.355387 Sep 09 21:06:30.054011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 91/175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:29 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:30.700890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:30.701772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:30.726708 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:30.729125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:30.735432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:30.735432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:30.736587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:30.737489 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:31.048635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:31.057196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-37e9dd44-1edf-44d3-b118-d6694ca7a138 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.360660 Sep 09 21:06:31.058260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 85/176] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:30 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:31.076809 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:31.077413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:31.092596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:31.093482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:31.094092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:31.094990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:31.095593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:31.096214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:31.404655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:31.415853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-451346c3-a21c-4b41-9758-3b4b7e76b5c2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1363 microversion: 2.1 time: 0.342889 Sep 09 21:06:31.428093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 92/177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:31 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:31.733535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-72d6f2a7-87a3-4056-9cb2-7598c9916bc6 req-2997a966-329d-4c7c-93a3-f72260ff2858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:31.762091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-72d6f2a7-87a3-4056-9cb2-7598c9916bc6 req-2997a966-329d-4c7c-93a3-f72260ff2858 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:31.762582 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-72d6f2a7-87a3-4056-9cb2-7598c9916bc6 req-2997a966-329d-4c7c-93a3-f72260ff2858 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:31.766123 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-72d6f2a7-87a3-4056-9cb2-7598c9916bc6 req-2997a966-329d-4c7c-93a3-f72260ff2858 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:31.784239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-72d6f2a7-87a3-4056-9cb2-7598c9916bc6 req-2997a966-329d-4c7c-93a3-f72260ff2858 service nova] Creating event network-changed:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:06:31.802111 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-72d6f2a7-87a3-4056-9cb2-7598c9916bc6 req-2997a966-329d-4c7c-93a3-f72260ff2858 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068628 Sep 09 21:06:31.804691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 86/178] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:32.082902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:32.084884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:32.096104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:32.096594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:32.097028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:32.097736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:32.102405 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:32.102881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:32.415550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:32.433568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-74c4598b-ab61-4e0c-acd2-ebd7a2cc2b38 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.351754 Sep 09 21:06:32.433568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 93/179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:32 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:32.440454 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:32.441175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:32.452723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:32.455841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:32.456336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:32.459003 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:32.459652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:32.468657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:32.865483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:32.876388 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-27b2f8e8-8365-49d3-bab6-4256c7006c17 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1550 microversion: 2.1 time: 0.440454 Sep 09 21:06:32.876984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 87/180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:32 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1550 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:32.901752 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:32.902479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:32.916744 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:32.917551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:32.918036 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:32.919944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:32.920605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:32.921184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:33.273103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bb6658e4-d7c3-4789-be5d-76853837b36a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.375128 Sep 09 21:06:33.275092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 94/181] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:06:32 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-interface => generated 285 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:33.455089 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:33.455863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:33.465977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:33.470552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:33.472462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:33.473523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:33.479165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:33.480047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:34.034282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:34.045644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3e2cae29-5133-4e42-bd25-23c06d5f498d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.594426 Sep 09 21:06:34.046293 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 88/182] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:33 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:35.072714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:35.075419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:35.093392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:35.093392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:35.093392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:35.093392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:35.093773 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:35.097466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:35.272055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:35.273388 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:35.284979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:35.284979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:35.284979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:35.284979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:35.285429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:35.285429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:35.289255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:35.332150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:06:35.488993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:35.501958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-76cff3df-f178-406d-9bcd-7eb91429d03c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.433711 Sep 09 21:06:35.514687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 95/183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:35 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:35.732556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2867b397-b57d-49dd-9d23-4648fb7533ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 204 len: 0 microversion: 2.1 time: 0.464740 Sep 09 21:06:35.733522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 89/184] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:06:35 2022] DELETE /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 21:06:35.742574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:35.743608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:35.750252 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:35.751124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:35.751759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:35.752748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:35.753412 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:35.754036 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:36.166384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:36.175607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c9c30564-1ce7-441b-aa64-18fcee82f1ef tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1552 microversion: 2.1 time: 0.437442 Sep 09 21:06:36.176223 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 96/185] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:35 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1552 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:36.524334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-1b84d402-ff38-4d3e-9a2d-e5cf6ef06e17 req-25565caa-0a06-4ceb-b098-31c0c1e6c695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f14bf7b-dd56-44e0-bd6a-cd546c3956ca", "tag": "24603941-285a-42e6-adac-2398e3dbcba9"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:36.539977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:36.540914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:36.547669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-1b84d402-ff38-4d3e-9a2d-e5cf6ef06e17 req-25565caa-0a06-4ceb-b098-31c0c1e6c695 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:36.548894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-1b84d402-ff38-4d3e-9a2d-e5cf6ef06e17 req-25565caa-0a06-4ceb-b098-31c0c1e6c695 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:36.551299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-1b84d402-ff38-4d3e-9a2d-e5cf6ef06e17 req-25565caa-0a06-4ceb-b098-31c0c1e6c695 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:36.554027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:36.554538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:36.555290 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:36.556287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:36.556933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:36.557501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:36.585393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-1b84d402-ff38-4d3e-9a2d-e5cf6ef06e17 req-25565caa-0a06-4ceb-b098-31c0c1e6c695 service nova] Creating event network-changed:24603941-285a-42e6-adac-2398e3dbcba9 for instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca on hv-cinder-83124 Sep 09 21:06:36.594656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-1b84d402-ff38-4d3e-9a2d-e5cf6ef06e17 req-25565caa-0a06-4ceb-b098-31c0c1e6c695 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075979 Sep 09 21:06:36.595671 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 90/186] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:37.087472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:37.096486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c4c6b595-e969-4985-aa22-a75b1c8407cb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.560464 Sep 09 21:06:37.097690 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 97/187] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:36 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:37.201916 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:37.203112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:37.212369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:37.213017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:37.213888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:37.214623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:37.215067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:37.215483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:37.433937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:37.454001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f806c95e-6ca5-4bd9-823f-6bdb586479ab tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1552 microversion: 2.1 time: 0.258976 Sep 09 21:06:37.454773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 91/188] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:37 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1552 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:38.121168 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:38.121784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:38.128196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:38.131253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:38.131253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:38.131253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:38.131636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:38.131905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:38.352677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:38.368950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-70928221-517d-4f70-b055-d6f9eb1a9db8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.251938 Sep 09 21:06:38.369547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 98/189] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:38 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:38.484012 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:38.485217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:38.496236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:38.498435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:38.499807 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:38.500884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:38.502509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:38.504018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:38.726845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:38.738250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-92a0a06e-a3d7-461e-a631-013c8f643aca tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1552 microversion: 2.1 time: 0.260591 Sep 09 21:06:38.741118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 92/190] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:38 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1552 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:39.394886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:39.395568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:39.402065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:39.402548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:39.402975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:39.403672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:39.404145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:39.404571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:39.563007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-77e0f485-38b4-4168-b3db-93533cb9d55d req-e4f5d8b4-6e81-4ce7-a056-a1e91694bef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30c2af5-2694-4833-b3d2-f0a5393befbf", "name": "network-vif-deleted", "tag": "775e8203-a412-4b32-aedc-6a82490a4126"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:39.577826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-77e0f485-38b4-4168-b3db-93533cb9d55d req-e4f5d8b4-6e81-4ce7-a056-a1e91694bef5 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:39.578577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-77e0f485-38b4-4168-b3db-93533cb9d55d req-e4f5d8b4-6e81-4ce7-a056-a1e91694bef5 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:39.579006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-77e0f485-38b4-4168-b3db-93533cb9d55d req-e4f5d8b4-6e81-4ce7-a056-a1e91694bef5 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:39.597169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-77e0f485-38b4-4168-b3db-93533cb9d55d req-e4f5d8b4-6e81-4ce7-a056-a1e91694bef5 service nova] Creating event network-vif-deleted:775e8203-a412-4b32-aedc-6a82490a4126 for instance c30c2af5-2694-4833-b3d2-f0a5393befbf on hv-cinder-83124 Sep 09 21:06:39.605144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-77e0f485-38b4-4168-b3db-93533cb9d55d req-e4f5d8b4-6e81-4ce7-a056-a1e91694bef5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045185 Sep 09 21:06:39.607205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 93/191] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:06:39.617533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:39.618335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dab82f9b-9058-405e-a668-5cde6839c4fb tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.227358 Sep 09 21:06:39.623866 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:39 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:39.768007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:39.770031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:39.776469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:39.776967 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:39.777399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:39.778104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:39.778555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:39.779171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:39.872709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:39.884644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-349333d9-41dc-48fe-9ee3-806deb7d2579 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1344 microversion: 2.1 time: 0.121496 Sep 09 21:06:39.895416 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:39 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:40.550162 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ca7a03e4-09ab-4df1-a5ba-6000b6b19a91 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Action: 'create', calling method: .version_select at 0x7fa1d0d69ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1420081761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgVnN0bX6ziSLyuMNZwKTbcsu3imVvaH76enXmWbnFh3q5Lu1Cjaqp0/x0jMMQOFAWUg8JANnUYJr+rkS2ZRBLG3CqX+Kwfn4oHX343mJsQUzJptfDBRdeAesBqRuXA1A=="}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:06:40.597933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-ca7a03e4-09ab-4df1-a5ba-6000b6b19a91 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Getting quotas for project d26a3ee560e449b8b1188b9defa98fa6. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:06:40.606952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-ca7a03e4-09ab-4df1-a5ba-6000b6b19a91 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Getting quotas for user b17adcb2be25427485d5004c7821e094 and project d26a3ee560e449b8b1188b9defa98fa6. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:06:40.641962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:40.646983 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:40.651379 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:40.652701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:40.652701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:40.653492 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:40.654015 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:40.654518 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:40.713399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ca7a03e4-09ab-4df1-a5ba-6000b6b19a91 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.416293 Sep 09 21:06:40.713715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 100/194] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:06:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:06:40.866169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:40.875949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bde4b8ce-55dc-4b38-b32a-b01f7a88dbcd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.237767 Sep 09 21:06:40.880914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:40 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:40.928467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:40.929992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:40.941484 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:40.945146 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:40.946407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:40.947448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:40.951850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:40.952781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:41.004108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:41.004842 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:41.005968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:41.006511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lazy-loading 'fault' on Instance uuid c30c2af5-2694-4833-b3d2-f0a5393befbf {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:06:41.054585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e9308215e94c5e9e615be1f2a113b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46978366f11c4af79a9e9ad6ff2e5e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:41.064894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a721c0ee-1cf4-4591-8d47-8277f63f57e0 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 200 len: 1349 microversion: 2.1 time: 0.140447 Sep 09 21:06:41.064894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 101/196] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:40 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 1349 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:41.903642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:41.904282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:41.910596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:41.911072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:41.911502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:41.912869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:41.913320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:41.913739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:42.094348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:42.095104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:42.096358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:42.103659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:42.104312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:42.105036 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:42.105589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2783b245-4968-4d17-9086-a4134d1e1b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.205508 Sep 09 21:06:42.106327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:41 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:42.106700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:42.107259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:42.108166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:42.123836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] HTTP exception thrown: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Request method failure captured: Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf HTTP/1.1 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qeRsHrPmQSizGbDJfg47a1A9Hsb95Zwf_yP-lj3iSDj1STZeC3dbJ-ntMVc4tGKQnR7eHApPwabzsBrmWZ3QqWLo8TTBZwNrjVET9tu1nnoZafyx0ZocFsQl0liXUu4ctOqftMdWVnzvB4I-TCEjWpJPlCCZDLcWT6KRvramxXsj4 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:06:42.129000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 83e9308215e94c5e9e615be1f2a113b1 Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.130410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'c30c2af5-2694-4833-b3d2-f0a5393befbf'} Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:06:42.131178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.132649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.133950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Returning 404 to user: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:06:42.133950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-97686618-739c-402a-ab66-8b6387fe62f3 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 404 len: 111 microversion: 2.1 time: 0.042803 Sep 09 21:06:42.133950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 102/198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:42 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:06:42.265758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:42.267797 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:42.274690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:42.275457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:42.276117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:42.277232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:42.278219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:42.278863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:42.292911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] HTTP exception thrown: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Request method failure captured: Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf/os-volume_attachments HTTP/1.1 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qeRsHrPmQSizGbDJfg47a1A9Hsb95Zwf_yP-lj3iSDj1STZeC3dbJ-ntMVc4tGKQnR7eHApPwabzsBrmWZ3QqWLo8TTBZwNrjVET9tu1nnoZafyx0ZocFsQl0liXUu4ctOqftMdWVnzvB4I-TCEjWpJPlCCZDLcWT6KRvramxXsj4 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:06:42.297739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 83e9308215e94c5e9e615be1f2a113b1 Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.299213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'server_id': 'c30c2af5-2694-4833-b3d2-f0a5393befbf'} Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:06:42.300128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:42.301574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:42.302896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Returning 404 to user: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:06:42.302896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-adbcb537-cd70-47e9-aa97-c66279da3835 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042250 Sep 09 21:06:42.303887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 97/199] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:06:42 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:06:43.129442 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:43.130967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:43.138343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:43.139109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:43.141047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:43.141047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:43.141047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:43.142250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:43.284927 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:43.294439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4d18b489-1a99-4503-bf2e-835248de7255 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.169246 Sep 09 21:06:43.308992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 103/200] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:43 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:43.759689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:43.760231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:43.769864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:43.770453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:43.770871 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:43.772198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:43.772876 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:43.773457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:43.797024 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] HTTP exception thrown: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Request method failure captured: Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: DELETE /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf HTTP/1.1 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qeRsHrPmQSizGbDJfg47a1A9Hsb95Zwf_yP-lj3iSDj1STZeC3dbJ-ntMVc4tGKQnR7eHApPwabzsBrmWZ3QqWLo8TTBZwNrjVET9tu1nnoZafyx0ZocFsQl0liXUu4ctOqftMdWVnzvB4I-TCEjWpJPlCCZDLcWT6KRvramxXsj4 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:06:43.799408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 83e9308215e94c5e9e615be1f2a113b1 Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.800714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'c30c2af5-2694-4833-b3d2-f0a5393befbf'} Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:06:43.801455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.802548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.816425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Returning 404 to user: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:06:43.817361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-568f19c8-64f6-432c-8982-5b283c1f8dbd tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 404 len: 111 microversion: 2.1 time: 0.062530 Sep 09 21:06:43.818467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 98/201] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:06:43 2022] DELETE /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:06:43.831858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:43.832508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] [instance: c30c2af5-2694-4833-b3d2-f0a5393befbf] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:43.843758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:43.844298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:43.847792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:43.855439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:43.855439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:43.855439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:43.874480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] HTTP exception thrown: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Request method failure captured: Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf HTTP/1.1 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qeRsHrPmQSizGbDJfg47a1A9Hsb95Zwf_yP-lj3iSDj1STZeC3dbJ-ntMVc4tGKQnR7eHApPwabzsBrmWZ3QqWLo8TTBZwNrjVET9tu1nnoZafyx0ZocFsQl0liXUu4ctOqftMdWVnzvB4I-TCEjWpJPlCCZDLcWT6KRvramxXsj4 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:06:43.876210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_46978366f11c4af79a9e9ad6ff2e5e05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 46978366f11c4af79a9e9ad6ff2e5e05 Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-DeleteServersTestJSON-58952887 Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 83e9308215e94c5e9e615be1f2a113b1 Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-DeleteServersTestJSON-58952887-project Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.877480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'c30c2af5-2694-4833-b3d2-f0a5393befbf'} Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:06:43.878128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. Sep 09 21:06:43.879181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:06:43.883964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] Returning 404 to user: Instance c30c2af5-2694-4833-b3d2-f0a5393befbf could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:06:43.883964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e92e451f-a194-4795-9860-6a8b19c9a845 tempest-DeleteServersTestJSON-58952887 tempest-DeleteServersTestJSON-58952887-project] 10.222.0.48 "GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf" status: 404 len: 111 microversion: 2.1 time: 0.051445 Sep 09 21:06:43.883964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:43 2022] GET /compute/v2.1/servers/c30c2af5-2694-4833-b3d2-f0a5393befbf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:06:44.320292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:44.320901 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:44.327977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:44.328508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:44.328938 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:44.329887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:44.330426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:44.330747 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:44.525394 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:44.535092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8dde44e2-a656-4d3e-a045-a5c31a0a38b1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.219596 Sep 09 21:06:44.535883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 99/203] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:44 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:45.584696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:45.585303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:45.599841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:45.600231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:45.600659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:45.601359 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:45.601863 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:45.602453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:45.841390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:45.852630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-93ed7aaa-9ddb-4bbf-b41a-6c8096b51d47 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.289078 Sep 09 21:06:45.853777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 105/204] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:45 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:46.877555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:46.878445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:46.881535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:46.886179 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:46.886741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:46.887179 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:46.888165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:46.888732 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:46.889165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:47.065959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:47.065959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2ad02f22-586a-422a-b4ea-2875f610b21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.154608 Sep 09 21:06:47.065959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 100/205] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:46 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:48.086351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:48.087112 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:48.096706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:48.097280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:48.097780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:48.098761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:48.100339 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:48.101161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:48.122536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:48.289996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:48.297464 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-29fbb76a-7642-4d1a-8faa-1c61c8287aac tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.217242 Sep 09 21:06:48.298022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 106/206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:48 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:49.321301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:49.321876 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:49.329188 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:49.330214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:49.330214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:49.331019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:49.331723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:49.332178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:49.579140 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:49.586859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1276cdbf-f00f-4a03-ace4-b6ed6e5f8258 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.270508 Sep 09 21:06:49.587426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 101/207] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:49 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:50.610445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:50.611057 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:50.614478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=4 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:50.617806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:50.618279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:50.618710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:50.619389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:50.619832 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:50.620279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:50.749939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:50.759746 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7fe7837a-ad3d-4089-9199-d8112337b536 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.154486 Sep 09 21:06:50.764693 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 107/208] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:50 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:51.785077 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:51.787748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:51.793777 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:51.794273 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:51.794708 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:51.795398 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:51.795848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:51.796299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:51.972805 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:51.981185 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-97a633ea-9b18-4eea-9b08-9a060aeec21d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.200667 Sep 09 21:06:51.982006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 102/209] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:51 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:53.004661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:53.005726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:53.013854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:53.014338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:53.015639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:53.017337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:53.018096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:53.018524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:53.258772 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:53.267036 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0ea435f6-4d65-4a98-9eba-5d67d567e4d4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.266461 Sep 09 21:06:53.267724 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 108/210] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:52 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:54.291986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:54.298182 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:54.298986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:54.299470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:54.300337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:54.300627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:54.301078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:54.301501 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:54.436861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:54.445355 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-cd488d94-d10c-4537-9523-a64544ac6b97 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.158009 Sep 09 21:06:54.456532 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 103/211] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:54 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:55.471905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:55.472647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:55.480966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:55.482187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:55.482829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:55.484284 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:55.485746 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:55.486487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:55.708839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:55.716560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0a46c14f-1e06-4b4d-a45e-e20c50cb7033 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.250632 Sep 09 21:06:55.719746 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 109/212] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:55 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:56.738773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:56.739905 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:56.746529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:56.747009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:56.747447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:56.748205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:56.748658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:56.749095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:56.889144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:56.898323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1d70ee30-9920-4cc6-ab51-a8bffe9b4f91 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.163294 Sep 09 21:06:56.899456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 104/213] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:56 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:57.922111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:57.922646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:57.929277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:57.929812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:57.930269 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:57.936209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:57.936209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:57.936209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:58.116850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:58.127385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-cffe734a-ac82-451d-8aba-1fedd9f01679 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.208869 Sep 09 21:06:58.128120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 110/214] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:57 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:06:59.152798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:06:59.153517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:06:59.160956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:59.161506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:59.161933 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:59.162628 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:06:59.163070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:06:59.167104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:06:59.317046 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:06:59.332374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-937bf327-167e-4177-88fb-8fc7d0dc9d1b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.183701 Sep 09 21:06:59.333196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 105/215] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:06:59 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:00.358341 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:00.359109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:00.362190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:00.365621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:00.366095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:00.366525 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:00.367213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:00.367660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:00.368098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:00.540590 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:00.557530 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0e94c1c5-1541-41ab-bc62-24b82efa9656 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.205331 Sep 09 21:07:00.558642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 111/216] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:00 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:01.594589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:01.595405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:01.604021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:01.605873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:01.605873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:01.606725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:01.607653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:01.608588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:01.776408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:01.778683 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:01.785279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b41809a2-e333-439d-90bf-49e3d38aed64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.200950 Sep 09 21:07:01.785847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 106/217] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:01 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:02.809257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:02.809981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:02.817045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:02.818373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:02.818819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:02.819687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:02.820219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:02.820808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:02.981069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:02.990016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c6d3a159-7151-42b4-b6cf-553cfed5a7b4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.185124 Sep 09 21:07:02.990896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 112/218] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:02 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:04.015282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:04.016439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:04.023028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:04.023510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:04.023943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:04.024669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:04.025153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:04.025574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:04.153094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:04.161084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-09936925-88f4-484e-a8c3-a88366d275f1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.151073 Sep 09 21:07:04.161702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 107/219] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:04 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:05.184592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:05.185114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:05.191204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:05.199737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:05.199737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:05.199737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:05.199737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:05.200128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:05.321851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:05.329882 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-de855450-32d9-4776-861c-23b0a13e0fe4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.149195 Sep 09 21:07:05.344321 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 113/220] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:05 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:06.353883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:06.354531 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:06.361988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:06.362479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:06.362909 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:06.363603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:06.364716 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:06.379949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:06.508186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:06.515868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-646e534a-49cb-499e-aa48-b4a3c7895581 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.166296 Sep 09 21:07:06.516485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 108/221] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:06 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:07.538455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:07.539204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:07.545242 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:07.545720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:07.546160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:07.546852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:07.547300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:07.547721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:07.674602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:07.681648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8854f70c-53f4-42a4-b615-b082e354fbd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.147045 Sep 09 21:07:07.682266 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 114/222] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:07 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:08.705462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:08.706066 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:08.713295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:08.713767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:08.714189 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:08.714870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:08.715334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:08.715787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:08.848408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:08.856174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-04f02d6c-d2fa-464d-a68e-e1b572cf5fd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1520 microversion: 2.1 time: 0.154813 Sep 09 21:07:08.856903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 109/223] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:08 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:09.878550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:09.879093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:09.885022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:09.885494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:09.885923 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:09.886598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:09.887042 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:09.887455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:10.018015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:10.026209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-64815ea6-a7a1-488a-bec5-2454290b49fd tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1500 microversion: 2.1 time: 0.151485 Sep 09 21:07:10.026762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 115/224] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:09 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:10.047996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:10.048631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:10.055161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:10.055635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:10.056081 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:10.056770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:10.057222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:10.057643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:10.181316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:10.188931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-47cf0fdb-4241-43b6-a61b-fb9930cd3d4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1515 microversion: 2.1 time: 0.144654 Sep 09 21:07:10.189490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 110/225] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:10 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1515 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:16.092276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:16.094583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:16.100935 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:16.101516 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:16.102135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:16.102617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:16.103076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:16.103482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:16.127919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lazy-loading 'flavor' on Instance uuid cdb100de-b697-4ed6-9765-b93b4e58cf88 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:07:16.469688 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6c7ede4a-d843-482d-888a-87f3886a3e64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/action" status: 200 len: 32 microversion: 2.1 time: 0.380903 Sep 09 21:07:16.470646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 116/226] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:07:16 2022] POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 21:07:16.480751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:16.481193 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:16.488153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:16.488516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:16.488954 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:16.490191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:16.490191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:16.491201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:16.685935 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:16.694824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-51cfe685-6efa-4b5d-b1d1-fd16f4ff9790 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.218168 Sep 09 21:07:16.696109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 111/227] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:16 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:17.728398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:17.728398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:17.732117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:17.732588 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:17.733015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:17.733708 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:17.734155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:17.734887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:17.872988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:17.882400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-022204dc-8fbf-4843-bebf-0b322d689633 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.164292 Sep 09 21:07:17.883137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 117/228] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:17 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:18.906450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:18.910351 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:18.914349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:18.915014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:18.915608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:18.916337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:18.916821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:18.917261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:19.057932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:19.067259 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4f1489bf-e51f-4f42-a95a-b0baae881a67 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.164670 Sep 09 21:07:19.068959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 112/229] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:18 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:20.097147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:20.097756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:20.104993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:20.105664 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:20.106088 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:20.106776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:20.107230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:20.107637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:20.258629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:20.267176 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dbb969d1-679a-4ee8-833d-b273b65bc53d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.175089 Sep 09 21:07:20.267757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 118/230] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:20 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:21.291811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:21.292686 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:21.300403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:21.300887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:21.301320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:21.302008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:21.302483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:21.303577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:21.440722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:21.449104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-dd02cfa8-69ca-476d-8c0b-325ca87042de tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.162159 Sep 09 21:07:21.449618 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 113/231] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:21 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:22.472247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:22.473092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:22.479069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:22.479560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:22.479999 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:22.480725 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:22.481175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:22.481593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:22.486321 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:22.613319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:22.621765 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0537bd27-d0a2-4f40-9160-8b232db6907e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.153249 Sep 09 21:07:22.624132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 119/232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:22 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:23.404691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-302347294", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1420081761", "security_groups": [{"name": "tempest-secgroup-smoke-1217460517"}], "networks": [{"uuid": "55a79170-1004-4c59-abca-557008fff345"}], "block_device_mapping_v2": [{"uuid": "99da1b0e-86ce-495f-9eef-ff09d27cd432", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:23.453514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=28 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:23.595595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] validate_networks() for [('55a79170-1004-4c59-abca-557008fff345', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:07:23.646194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:23.647409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:23.653763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:23.654240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:23.654668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:23.655355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:23.655800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:23.656247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:23.873349 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:23.884469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-abe94d1a-c4f5-423e-ab42-6a7410d5fcea tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.242572 Sep 09 21:07:23.885327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 120/233] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:23 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:24.246353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:07:24.246972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:07:24.247769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:07:24.248364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:07:24.248824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:07:24.259996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:24.260698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:24.261133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:24.261863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:24.262316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:24.262730 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:24.279391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Getting quotas for project d26a3ee560e449b8b1188b9defa98fa6. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:07:24.283436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Getting quotas for user b17adcb2be25427485d5004c7821e094 and project d26a3ee560e449b8b1188b9defa98fa6. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:07:24.349182 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:07:24.351853 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='99da1b0e-86ce-495f-9eef-ff09d27cd432',volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:07:24.755849 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2234bd9f-9276-4e54-a55b-c2935d1a3b62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.357907 Sep 09 21:07:24.756862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 114/234] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:07:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:07:24.769868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-92e99b83-acaf-4ab2-90db-bd176fb58896 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:24.773758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-92e99b83-acaf-4ab2-90db-bd176fb58896 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:24.846262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-92e99b83-acaf-4ab2-90db-bd176fb58896 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:24.860767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-92e99b83-acaf-4ab2-90db-bd176fb58896 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1088 microversion: 2.1 time: 0.094639 Sep 09 21:07:24.862668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 121/235] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:24 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:24.910149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:24.910766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:24.918174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:24.918661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:24.919091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:24.919794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:24.920289 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:24.920710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:25.085957 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:25.093956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-657444d7-316d-430f-aae3-dad531a81834 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.188974 Sep 09 21:07:25.094743 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 115/236] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:24 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:25.887946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:25.888939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:25.896167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:25.899605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:25.899605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:25.899605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:25.899605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:25.899965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:25.966808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:25.972496 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-91cd1d6a-e174-483e-b33d-e10953189862 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1138 microversion: 2.1 time: 0.088443 Sep 09 21:07:25.973006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 122/237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:25 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:26.117052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:26.117902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:26.124348 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:26.124908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:26.129339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:26.129339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:26.129339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:26.129339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:26.257490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:26.265217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-678afcb8-9435-4110-b960-98b2d517c264 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.152081 Sep 09 21:07:26.265779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 116/238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:26 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:26.995610 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:26.996393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:27.003033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:27.003873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:27.004527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:27.005546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:27.006721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:27.007208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:27.081333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:27.089265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-eadf28ef-ddba-4b7d-b6f9-18913110cb4b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1186 microversion: 2.1 time: 0.097544 Sep 09 21:07:27.089876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 123/239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:26 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1186 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:27.291728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:27.292445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:27.299196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:27.300020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:27.300815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:27.301754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:27.302456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:27.303733 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:27.445129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:27.455487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-84c1ed24-8f98-4a68-93ba-3acf15a9deae tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.168062 Sep 09 21:07:27.456187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 117/240] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:27 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:28.116794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:28.117356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:28.123411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:28.123892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:28.124365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:28.125053 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:28.125507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:28.125925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:28.188487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:28.197237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5444690a-8258-4c9d-a12c-f5c5141efcd5 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1204 microversion: 2.1 time: 0.084311 Sep 09 21:07:28.198202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 124/241] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:28 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:28.479529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:28.480328 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:28.489362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:28.496502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:28.498641 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:28.499487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:28.500753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:28.501807 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:28.693775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:28.703278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e0c79c66-afd4-4fe2-a08c-569355d26add tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.228042 Sep 09 21:07:28.732407 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 118/242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:28 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:29.221561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:29.222108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:29.228041 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:29.228545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:29.228971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:29.229654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:29.230105 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:29.230525 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:29.366239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:29.373932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ef061642-10ab-4b1f-9610-c5f5f7db7859 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1272 microversion: 2.1 time: 0.156266 Sep 09 21:07:29.374496 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 125/243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:29 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:29.729504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:29.730150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:29.736756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:29.737293 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:29.737735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:29.743699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:29.743699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:29.743699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:29.874900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:29.884577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-78edc2b8-0779-4b44-b774-232276dea74f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.159113 Sep 09 21:07:29.890229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 119/244] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:29 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:30.378957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-1cb3a002-6dd0-44fd-b5ee-9f1f53dbbcb3 req-484230d4-a611-4525-91e5-d2998acffd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:30.388470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1cb3a002-6dd0-44fd-b5ee-9f1f53dbbcb3 req-484230d4-a611-4525-91e5-d2998acffd75 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:30.388934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1cb3a002-6dd0-44fd-b5ee-9f1f53dbbcb3 req-484230d4-a611-4525-91e5-d2998acffd75 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:30.389354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1cb3a002-6dd0-44fd-b5ee-9f1f53dbbcb3 req-484230d4-a611-4525-91e5-d2998acffd75 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:30.397434 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:30.398176 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:30.400602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-1cb3a002-6dd0-44fd-b5ee-9f1f53dbbcb3 req-484230d4-a611-4525-91e5-d2998acffd75 service nova] Creating event network-changed:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:07:30.405647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-1cb3a002-6dd0-44fd-b5ee-9f1f53dbbcb3 req-484230d4-a611-4525-91e5-d2998acffd75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031116 Sep 09 21:07:30.409142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:30.409142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:30.409812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 126/245] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:07:30.409929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:30.409929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:30.409929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:30.409929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:30.548941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:30.556744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9f7c5006-7f50-46f2-9b8e-a16e06188c2c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1272 microversion: 2.1 time: 0.163501 Sep 09 21:07:30.557302 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 120/246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:30 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:30.908038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:30.908897 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:30.915497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:30.915979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:30.916447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:30.917143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:30.917597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:30.918017 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:31.053477 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:31.067225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-398634a5-c94c-4dc2-bf07-6808d2e84738 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.162371 Sep 09 21:07:31.080899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 127/247] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:30 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:31.580469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:31.581069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:31.588241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:31.588721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:31.593283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:31.593283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:31.593283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:31.593283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:31.744241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:31.751904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3bc9ed1f-f8af-4eb0-a2dc-fd7a15fe3929 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1272 microversion: 2.1 time: 0.176172 Sep 09 21:07:31.752978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 121/248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:31 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:32.089768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:32.090396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:32.096564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.097037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.097793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.098150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.098595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.099131 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.239660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:32.248030 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-81da1c94-9dac-423b-94ab-82b212edae76 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1501 microversion: 2.1 time: 0.162156 Sep 09 21:07:32.250588 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 128/249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:32 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:32.282721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c3d5ba2-7f05-4d24-ada4-91684640d7f9"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:32.285775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:32.293232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.293717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.294144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.294844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.295531 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.295816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.320462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] HTTP exception thrown: Cannot 'attach_volume' instance cdb100de-b697-4ed6-9765-b93b4e58cf88 while it is in vm_state rescued Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Request method failure captured: Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/os-volume_attachments HTTP/1.1 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 74 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qVBwptcsDNcMpXRuR0L0x1hK1ma264iEAATbJPo2EBta7NTueIEfkpBnSyyzLWNXoCuwOlZDg3dCZUUupNMPMxinw7dOfz7k_DkchI-ApO_J8wOw2jNs9PWVLO_vRQ19l7QlRucRVD4PUIK2xwJxYyJvVsQ0Fd8dj5HZEiNuDYLR0 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:07:32.322053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25acf91bdf524474b03d44271d08fba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: c764d9778ef74b709cedbccabac37af0 Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {"volumeAttachment": {"volumeId": "2c3d5ba2-7f05-4d24-ada4-91684640d7f9"}} Sep 09 21:07:32.323574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Cannot 'attach_volume' instance cdb100de-b697-4ed6-9765-b93b4e58cf88 while it is in vm_state rescued Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'server_id': 'cdb100de-b697-4ed6-9765-b93b4e58cf88', 'body': {'volumeAttachment': {'volumeId': '2c3d5ba2-7f05-4d24-ada4-91684640d7f9'}}} Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:07:32.325479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cdb100de-b697-4ed6-9765-b93b4e58cf88 while it is in vm_state rescued Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:07:32.326885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cdb100de-b697-4ed6-9765-b93b4e58cf88 while it is in vm_state rescued Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Returning 409 to user: Cannot 'attach_volume' instance cdb100de-b697-4ed6-9765-b93b4e58cf88 while it is in vm_state rescued {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-26671150-8c2f-4273-8716-018efea911d1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044927 Sep 09 21:07:32.330538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 122/250] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:07:32 2022] POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 21:07:32.338675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:32.339211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:32.345283 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.345771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.346198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.346893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.347348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.347768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.547431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9db06b90-5793-4eb0-b93b-1e764a37aff4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/action" status: 202 len: 0 microversion: 2.1 time: 0.213055 Sep 09 21:07:32.551156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 129/251] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:07:32 2022] POST /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:07:32.558226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:32.559797 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:32.567208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.567885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.568369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.569082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.570037 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.570494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.719272 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:32.729346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-497793e8-d1a4-4742-a8ad-761b8cd47791 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1509 microversion: 2.1 time: 0.175833 Sep 09 21:07:32.743663 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 123/252] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:32 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:32.775623 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:32.776265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:32.784259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.785116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.785554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.786974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:32.788143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:32.788714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:32.931883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:32.940103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-60ba8275-f309-4c78-af87-5a436e5130d2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.168927 Sep 09 21:07:32.940667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 130/253] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:32 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:33.756124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:33.756741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:33.763145 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:33.763475 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:33.768914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:33.768914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:33.768914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:33.768914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:33.789640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:33.950740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:33.959904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-400501bb-af68-4a7b-ac49-6362aeef5e1a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1509 microversion: 2.1 time: 0.207661 Sep 09 21:07:33.961377 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 124/254] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:33 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:33.963542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:33.964453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:33.966485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=42 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:33.971336 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:33.971887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:33.972448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:33.973231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:33.973716 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:33.974198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:34.137056 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:34.145020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bbad2ca0-ed3c-4b11-81b2-c817214e2db7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.186128 Sep 09 21:07:34.145780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 131/255] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:33 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:34.985657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:34.986274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:34.988449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:34.989122 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:34.999237 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:34.999724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:35.001762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:35.002490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:35.002947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:35.003543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:35.171441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:35.171441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:35.171441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:35.176854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:35.177544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:35.178139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:35.179544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:35.180186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:35.180767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:35.372126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:35.379941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2492435e-29b9-4161-a9e2-cf172fca7b29 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1509 microversion: 2.1 time: 0.398367 Sep 09 21:07:35.380963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 125/256] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:34 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:35.386452 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:35.394487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-586c573e-91a4-49a1-a98e-572d0fa82a57 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.229282 Sep 09 21:07:35.395126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 132/257] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:35 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:36.403293 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:36.403900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:36.410186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:36.410668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:36.411172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:36.411864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:36.412340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:36.412755 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:36.416377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:36.416993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:36.423184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:36.423667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:36.424125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:36.424823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:36.428184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:36.428184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:36.631995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:36.642222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-528af8cf-2de8-4dc2-9be4-e3c6faacfd70 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1509 microversion: 2.1 time: 0.242682 Sep 09 21:07:36.643838 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 126/258] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:36 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:36.649482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:36.659437 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c41a32ac-2fb4-4725-b719-59f077d4a906 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.247206 Sep 09 21:07:36.660062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 133/259] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:36 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:37.665035 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:37.665645 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:37.674407 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:37.674895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:37.675329 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:37.677707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:37.678425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:37.679082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:37.682772 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:37.692348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:37.692348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:37.692348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:37.692348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:37.692677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:37.692677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:37.692677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:37.909363 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:37.913095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:37.917550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1a558673-6051-40d1-a0a2-7a3ca54a8b44 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1509 microversion: 2.1 time: 0.256301 Sep 09 21:07:37.918059 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 127/260] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:37 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:37.921202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f360b203-aca2-4bcd-a25b-13bfa0a53c27 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.243836 Sep 09 21:07:37.921756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 134/261] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:37 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:38.942126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:38.942820 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:38.949844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:38.950045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:38.950464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:38.950775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:38.950933 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:38.952361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:38.953549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:38.954143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:38.957240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:38.957720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:38.959488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:38.959488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:38.959708 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:38.960525 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:39.164314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:39.177841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:39.178218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c623e476-9e01-4de3-a2e2-5da38b7efa37 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.232363 Sep 09 21:07:39.188176 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 135/262] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:38 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:39.188437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-854d71c0-7d4a-47a2-81fe-fee982dc32e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1515 microversion: 2.1 time: 0.248112 Sep 09 21:07:39.188437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 128/263] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:38 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:40.201866 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:40.202475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:40.209348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:40.209957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:40.210399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:40.211264 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:40.211714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:40.212155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:40.227365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:40.346353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:40.355120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c1cde705-aeba-4b07-8768-6ac3e1e1faa1 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.157115 Sep 09 21:07:40.355690 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 136/264] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:40 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:41.383132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:41.383950 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:41.390776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:41.394767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:41.394767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:41.394767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:41.394767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:41.395134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:41.529372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:41.537171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2131eeea-d9d6-4af6-80ef-88be94b92811 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.162407 Sep 09 21:07:41.537729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 129/265] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:41 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:42.298252 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f6c7e2ce-0990-46ae-9792-4c22192ea225 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'create', calling method: .version_select at 0x7fa1d0b07430>, body: {"keypair": {"name": "tempest-keypair-1748114827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNr/zN90aApTmNCkcGZrd5h8bxz9k6KLCHMwdLUfr58+HQrbFieyAsZdsCXZ+ATGIQmOV/uxF40zg22Et/imjQ0ADbCX34IZkiVWtQ3U3FQNfrCiVx0cRmgwwJQGxTAOww=="}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:42.314848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-f6c7e2ce-0990-46ae-9792-4c22192ea225 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for project 25acf91bdf524474b03d44271d08fba6. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:07:42.318929 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-f6c7e2ce-0990-46ae-9792-4c22192ea225 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for user c764d9778ef74b709cedbccabac37af0 and project 25acf91bdf524474b03d44271d08fba6. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:07:42.437366 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f6c7e2ce-0990-46ae-9792-4c22192ea225 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143751 Sep 09 21:07:42.438045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 137/266] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:07:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:07:42.560508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:42.561132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:42.568055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:42.568561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:42.568989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:42.569681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:42.570402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:42.570821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:42.724551 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:42.733093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b57934a5-fa1f-4ea4-b070-de8ab28e306a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.176843 Sep 09 21:07:42.733653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 130/267] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:42 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:43.756046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:43.756842 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:43.763489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:43.766980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:43.767450 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:43.768771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:43.768771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:43.770541 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:43.967870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:43.976734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-780ef012-2161-495e-b34f-b77445004156 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.224530 Sep 09 21:07:43.977307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 138/268] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:43 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:44.503932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-937595504", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "networks": [{"uuid": "1be43f80-ec8e-4091-b48a-8be2b06a7edc"}]}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:44.560701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] validate_networks() for [('1be43f80-ec8e-4091-b48a-8be2b06a7edc', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:07:44.894746 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1162870422", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8868cdd0-53b5-4cee-ad5d-e353c07fbfb2"}], "security_groups": [{"name": "tempest-securitygroup--422248433"}], "key_name": "tempest-keypair-1748114827", "user_data": "}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:44.971929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:07:44.972391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:07:44.972859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:07:44.973264 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:07:44.973671 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:07:44.982728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:44.983200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:44.983629 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:44.984370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:44.984814 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:44.985229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:45.002053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Getting quotas for project ce9d99ec2c254abaa341c4cab6f2c534. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:07:45.006151 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Getting quotas for user 0d9129eaa2694ef6b3f006b67ef88c52 and project ce9d99ec2c254abaa341c4cab6f2c534. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:07:45.013653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] validate_networks() for [('8868cdd0-53b5-4cee-ad5d-e353c07fbfb2', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:07:45.017787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:07:45.020746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:07:45.192235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2004260c-e7af-4aee-a7da-108060f36897 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691931 Sep 09 21:07:45.192947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 131/269] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:07:45.198661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:45.199632 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:45.206386 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:45.206939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:45.211709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:45.211709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:45.211709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:45.211709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:45.455768 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:45.464139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5c666105-9de2-4281-93ec-8f0e9f3ff1f7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.269843 Sep 09 21:07:45.464710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 132/270] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:45 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:45.469251 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8cb9bce4-5ee6-4ee4-b844-258578f1d7ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:45.469858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8cb9bce4-5ee6-4ee4-b844-258578f1d7ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:45.498253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:07:45.498671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:07:45.499161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:07:45.499567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:07:45.499971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:07:45.509830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:45.510303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:45.510727 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:45.511436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:45.511877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:45.512325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:45.527454 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8cb9bce4-5ee6-4ee4-b844-258578f1d7ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:45.529227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for project 25acf91bdf524474b03d44271d08fba6. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:07:45.533171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Getting quotas for user c764d9778ef74b709cedbccabac37af0 and project 25acf91bdf524474b03d44271d08fba6. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:07:45.534326 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8cb9bce4-5ee6-4ee4-b844-258578f1d7ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1218 microversion: 2.1 time: 0.068681 Sep 09 21:07:45.534996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 133/271] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:45 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:45.545139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:07:45.547643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:07:45.716941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3d584fe8-c4aa-4b4f-8281-9c2793ffde0b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.826567 Sep 09 21:07:45.717520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 139/272] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:07:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:07:45.728552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3e4b7351-327b-480f-be59-6553b5cd42a9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:45.729222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3e4b7351-327b-480f-be59-6553b5cd42a9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:45.788785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3e4b7351-327b-480f-be59-6553b5cd42a9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:45.796615 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3e4b7351-327b-480f-be59-6553b5cd42a9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1246 microversion: 2.1 time: 0.071696 Sep 09 21:07:45.797262 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 134/273] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:45 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:46.487681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:46.488337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:46.494381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:46.494852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:46.495273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:46.496000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:46.496482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:46.496894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:46.558467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:46.559265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:46.565252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:46.565744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:46.566323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:46.567552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:46.568009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:46.568461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:46.632999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:46.640402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4b9c00c2-40af-4dd8-b843-231dd8925553 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1222 microversion: 2.1 time: 0.086749 Sep 09 21:07:46.640958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 135/274] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:46 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:46.656408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:46.663942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8595255a-488f-434b-9a57-f3dc2e6721ed tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.180279 Sep 09 21:07:46.664518 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 140/275] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:46 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:46.821220 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:46.821788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:46.827612 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:46.828377 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:46.828805 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:46.829491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:46.829924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:46.830354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:46.889476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:46.896931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8ebe54d0-cc2b-490f-9b3a-b82ef04154d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1250 microversion: 2.1 time: 0.080170 Sep 09 21:07:46.897513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 136/276] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:46 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:47.662759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:47.663370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:47.669921 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:47.670413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:47.670874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:47.671567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:47.672016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:47.672467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:47.686247 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:47.686860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:47.693297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:47.693779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:47.694213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:47.695912 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:47.696685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:47.697110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:47.737254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:47.745499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f1ee59cd-d72c-4c2f-94cb-ba26c6f1538a tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1222 microversion: 2.1 time: 0.086572 Sep 09 21:07:47.746070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 141/277] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:47 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:47.920908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:47.921568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:47.927572 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:47.928057 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:47.928519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:47.929226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:47.929673 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:47.930097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:48.002887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:48.014024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1e964e16-3e84-4ee5-b049-a4a5bd4abbc2 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1250 microversion: 2.1 time: 0.096983 Sep 09 21:07:48.015302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 142/278] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:47 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:48.060697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:48.068157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-af19f1d4-d237-4887-ae10-62b773679ed2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.385759 Sep 09 21:07:48.068715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 137/279] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:47 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:48.768202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:48.768806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:48.775235 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:48.775778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:48.776233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:48.776915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:48.777361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:48.777774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:48.841985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:48.849704 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c08f0328-afc7-411f-a9de-9a99315d51d9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1214 microversion: 2.1 time: 0.085405 Sep 09 21:07:48.850325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 143/280] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:48 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:49.037439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:49.038210 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:49.048458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.049193 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.049883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.051616 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.052290 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.052793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.096916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:49.096916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:49.102689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.102689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.102689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.102689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.103013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.103013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.127608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:49.135799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-73668626-c0e2-47d7-8ed3-40013fddf97a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1242 microversion: 2.1 time: 0.102325 Sep 09 21:07:49.136692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 138/281] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:49 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:49.240658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:49.248968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-df65da6a-89aa-4256-b4f9-fd9cb5e1d501 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.160940 Sep 09 21:07:49.249685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 144/282] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:49 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:49.254279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-7a02ed5f-e1c8-4315-bc7b-20c6940076bc req-6d08d535-b04f-4b5a-9db2-5f6d220191de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "name": "network-vif-plugged", "status": "completed", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:49.265060 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7a02ed5f-e1c8-4315-bc7b-20c6940076bc req-6d08d535-b04f-4b5a-9db2-5f6d220191de service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.265527 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7a02ed5f-e1c8-4315-bc7b-20c6940076bc req-6d08d535-b04f-4b5a-9db2-5f6d220191de service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.265947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7a02ed5f-e1c8-4315-bc7b-20c6940076bc req-6d08d535-b04f-4b5a-9db2-5f6d220191de service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.277189 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-7a02ed5f-e1c8-4315-bc7b-20c6940076bc req-6d08d535-b04f-4b5a-9db2-5f6d220191de service nova] Creating event network-vif-plugged:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:07:49.282844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-7a02ed5f-e1c8-4315-bc7b-20c6940076bc req-6d08d535-b04f-4b5a-9db2-5f6d220191de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033031 Sep 09 21:07:49.284926 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 139/283] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:07:49.873173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:49.874506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:49.880553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.881023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.881617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.883057 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:49.883700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:49.884310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:49.955435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:49.965631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5a6e2098-65b7-4d60-ad1c-4479c336efbe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1278 microversion: 2.1 time: 0.096590 Sep 09 21:07:49.966311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 145/284] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:49 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:50.165013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:50.165821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:50.172696 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:50.183485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:50.183485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:50.183485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:50.183485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:50.183848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:50.243694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:50.254232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f33378fc-bf12-4cfc-977e-e428144937c9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1298 microversion: 2.1 time: 0.092227 Sep 09 21:07:50.255113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 140/285] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:50 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:50.274362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:50.274362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:50.281249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:50.282011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:50.282785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:50.283829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:50.284839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:50.285580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:50.449954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:50.459197 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-37b9f605-a0fd-44fe-ab47-01874142d77c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.190326 Sep 09 21:07:50.462483 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 146/286] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:50 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:50.988653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:50.989266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:50.995634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:50.996136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:50.997155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:50.997851 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:50.998301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:50.998723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:51.133159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:51.141113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0b23fb65-7152-4522-b993-dc1ea69e9838 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.156335 Sep 09 21:07:51.142062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 141/287] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:50 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:51.277729 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:51.278340 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:51.284380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:51.284868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:51.285305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:51.286022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:51.286488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:51.286900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:51.349490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:51.357649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6bafbbd5-602e-479c-83ea-1b61d19ab72a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1298 microversion: 2.1 time: 0.083777 Sep 09 21:07:51.358251 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 147/288] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:51 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:51.489660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:51.490309 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:51.497062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:51.497533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:51.497957 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:51.498635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:51.499313 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:51.499884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:51.624408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:51.631920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-924ebfd1-0896-4d99-903d-44e3f2d58f42 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1260 microversion: 2.1 time: 0.146669 Sep 09 21:07:51.633150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 142/289] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:51 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:52.165286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:52.165904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:52.175338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.175553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.175880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.177021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.177138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.177469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.332277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:52.341648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-38afb9a7-b238-4cfd-9005-7af312bb2111 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.180509 Sep 09 21:07:52.342829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 148/290] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:52 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:52.383279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:52.385080 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:52.392350 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.392981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.393508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.394425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.394940 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.395421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.462489 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:52.470945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ea4494d1-7436-4ceb-b452-ca9bfdcaaf58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1306 microversion: 2.1 time: 0.093771 Sep 09 21:07:52.471760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 143/291] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:52 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:52.563731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-eadbba76-c819-40bc-a7b7-b102ce2a15aa req-b22639bf-1e44-47ce-a158-86e453e0973e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06e076f0-cece-46e0-8e98-6310d871b07d", "tag": "2fc371e8-8d32-46a1-a568-93965a2dfe1e"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:52.577853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-eadbba76-c819-40bc-a7b7-b102ce2a15aa req-b22639bf-1e44-47ce-a158-86e453e0973e service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.578942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-eadbba76-c819-40bc-a7b7-b102ce2a15aa req-b22639bf-1e44-47ce-a158-86e453e0973e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.579813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-eadbba76-c819-40bc-a7b7-b102ce2a15aa req-b22639bf-1e44-47ce-a158-86e453e0973e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.789420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:52.789420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:52.789420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.789420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.790358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.790358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.790358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.790358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.790898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:52.791354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-eadbba76-c819-40bc-a7b7-b102ce2a15aa req-b22639bf-1e44-47ce-a158-86e453e0973e service nova] Creating event network-changed:2fc371e8-8d32-46a1-a568-93965a2dfe1e for instance 06e076f0-cece-46e0-8e98-6310d871b07d on hv-cinder-83124 Sep 09 21:07:52.791354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-eadbba76-c819-40bc-a7b7-b102ce2a15aa req-b22639bf-1e44-47ce-a158-86e453e0973e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195491 Sep 09 21:07:52.791354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 149/292] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:07:52.812741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:52.821341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-caf97bdb-5c97-4b9e-a023-a95775d33b76 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1444 microversion: 2.1 time: 0.168329 Sep 09 21:07:52.821910 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 144/293] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:52 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:52.845267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:52.967904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:52.967904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.967904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.967904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.968567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:52.968567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:52.968567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:52.987390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:52.996677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1d6cfa43-21e2-43bd-8523-3e9942ffb45d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1444 microversion: 2.1 time: 0.155583 Sep 09 21:07:52.998066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 150/294] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:52 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:53.368514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:53.369281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:53.378139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:53.378625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:53.379591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:53.380333 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:53.381171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:53.386873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:53.500818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:53.500818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:53.504476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:53.505153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:53.505750 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:53.506618 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:53.507277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:53.507851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:53.600960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:53.609418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6de232dd-a7d2-44c4-9921-059af4fb4e6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1304 microversion: 2.1 time: 0.115969 Sep 09 21:07:53.610353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 151/295] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:53 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:53.635506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:53.644325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fe063308-341f-41aa-beb2-1791942d995f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.282284 Sep 09 21:07:53.645434 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 145/296] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:53 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:54.632007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:54.632740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:54.638574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:54.639046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:54.639473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:54.640189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:54.640634 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:54.641048 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:54.668219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:54.669092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:54.671485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:54.676332 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:54.681892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:54.681892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:54.681892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:54.681892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:54.682279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:54.955162 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:54.963385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9cd7dd92-069b-4e73-9bed-03301d29ae5e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.335286 Sep 09 21:07:54.963946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 152/297] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:54 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:54.981287 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:54.989509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bd8273d8-e5d9-49b2-9032-73145d30ee30 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.325901 Sep 09 21:07:54.990083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 146/298] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:54 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:55.403490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-67486d2b-1036-47df-80a8-119f54d4d49c req-abfa8f44-e440-4945-ae12-caa5039e2635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:55.413643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-67486d2b-1036-47df-80a8-119f54d4d49c req-abfa8f44-e440-4945-ae12-caa5039e2635 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:55.414142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-67486d2b-1036-47df-80a8-119f54d4d49c req-abfa8f44-e440-4945-ae12-caa5039e2635 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:55.414623 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-67486d2b-1036-47df-80a8-119f54d4d49c req-abfa8f44-e440-4945-ae12-caa5039e2635 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:55.428369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-67486d2b-1036-47df-80a8-119f54d4d49c req-abfa8f44-e440-4945-ae12-caa5039e2635 service nova] Creating event network-changed:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:07:55.437110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-67486d2b-1036-47df-80a8-119f54d4d49c req-abfa8f44-e440-4945-ae12-caa5039e2635 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037233 Sep 09 21:07:55.437992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 153/299] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:07:55.986097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:55.986984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:55.988941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:55.990132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=10 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:55.997898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:55.997898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:55.998205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:55.998924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:55.999397 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:55.999825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:56.010137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:56.011190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=10 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:56.022364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:56.022364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:56.027463 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:56.027891 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:56.028351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:56.029046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:56.029490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:56.030070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:56.209773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:56.229785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4c86ebbb-eb38-4e67-8945-b50c1dda48ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.246496 Sep 09 21:07:56.233415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 147/300] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:55 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:56.258034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:56.269472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-10497033-1691-442d-8ded-6e66326aa809 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.260204 Sep 09 21:07:56.270051 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 154/301] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:56 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:57.260401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:57.262236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:57.268239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:57.268735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:57.269172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:57.269877 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:57.270329 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:57.270754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:57.294551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:57.296964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:57.307291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:57.310314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:57.310757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:57.311608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:57.312064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:57.312517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:57.515366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:57.527565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e92bfeb2-7b5d-44a1-827b-9905bf8514a7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.270324 Sep 09 21:07:57.534678 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 148/302] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:57 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:57.558529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:57.568365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ac2cd21a-7ab6-4f83-8382-247c3385db72 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.280313 Sep 09 21:07:57.569297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 155/303] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:57 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:07:58.078592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-3d44da8f-019b-4bc1-9b9b-d24354d3cadf req-9353723e-e6a1-4269-984b-2b80cc66f9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adcea70-5a82-48c8-9a07-54f1550e17f5", "tag": "499398d4-9eb5-4074-b98e-a0efaafdc265"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:58.091432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-3d44da8f-019b-4bc1-9b9b-d24354d3cadf req-9353723e-e6a1-4269-984b-2b80cc66f9fe service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:58.092404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-3d44da8f-019b-4bc1-9b9b-d24354d3cadf req-9353723e-e6a1-4269-984b-2b80cc66f9fe service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:58.092911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-3d44da8f-019b-4bc1-9b9b-d24354d3cadf req-9353723e-e6a1-4269-984b-2b80cc66f9fe service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:58.111285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-3d44da8f-019b-4bc1-9b9b-d24354d3cadf req-9353723e-e6a1-4269-984b-2b80cc66f9fe service nova] Creating event network-changed:499398d4-9eb5-4074-b98e-a0efaafdc265 for instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 on hv-cinder-83124 Sep 09 21:07:58.117510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-3d44da8f-019b-4bc1-9b9b-d24354d3cadf req-9353723e-e6a1-4269-984b-2b80cc66f9fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042985 Sep 09 21:07:58.118618 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 149/304] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:07:58.558888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:58.559811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:58.565875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:58.566352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:58.566783 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:58.567473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:58.567919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:58.568361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:58.571021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:58.594130 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:58.595520 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:58.616049 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:58.617072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:58.617738 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:58.618656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:58.619793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:58.620564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:58.742759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:58.753210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8c4eca71-7261-4a86-94d6-100a262d877f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.197841 Sep 09 21:07:58.753994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 156/305] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:58 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:58.822213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:07:58.831485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c48c694d-bc3a-4882-ae67-92df82242291 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.243784 Sep 09 21:07:58.842142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 150/306] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:58 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:07:59.333330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-31ddea36-6035-4030-9d79-fc4c225b9fb8 req-8a2118eb-ebce-43f5-b955-69a24097860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e076f0-cece-46e0-8e98-6310d871b07d", "name": "network-vif-plugged", "status": "completed", "tag": "2fc371e8-8d32-46a1-a568-93965a2dfe1e"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:07:59.345329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-31ddea36-6035-4030-9d79-fc4c225b9fb8 req-8a2118eb-ebce-43f5-b955-69a24097860f service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:59.345600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-31ddea36-6035-4030-9d79-fc4c225b9fb8 req-8a2118eb-ebce-43f5-b955-69a24097860f service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:59.346029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-31ddea36-6035-4030-9d79-fc4c225b9fb8 req-8a2118eb-ebce-43f5-b955-69a24097860f service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:59.360611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-31ddea36-6035-4030-9d79-fc4c225b9fb8 req-8a2118eb-ebce-43f5-b955-69a24097860f service nova] Creating event network-vif-plugged:2fc371e8-8d32-46a1-a568-93965a2dfe1e for instance 06e076f0-cece-46e0-8e98-6310d871b07d on hv-cinder-83124 Sep 09 21:07:59.365944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-31ddea36-6035-4030-9d79-fc4c225b9fb8 req-8a2118eb-ebce-43f5-b955-69a24097860f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036216 Sep 09 21:07:59.366576 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 157/307] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:07:59.776659 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:59.777304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:59.783471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:59.783949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:59.784712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:59.785236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:59.785760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:59.786187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:59.865408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:07:59.866108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:07:59.875354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:59.875840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:59.880582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:07:59.884121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:07:59.884121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:07:59.884121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:00.165738 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:00.173688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-254d1e74-be13-49ee-a86c-64494533b241 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.400908 Sep 09 21:08:00.174260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 151/308] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:59 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:00.210677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:00.218366 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a02bf2e4-df2d-4566-b9c2-b5a48ef4e5f1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.357309 Sep 09 21:08:00.218907 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 158/309] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:07:59 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:01.197380 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:01.198177 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:01.206223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:01.206903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:01.207339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:01.208081 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:01.208555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:01.208977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:01.241124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:01.243010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:01.251830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:01.252342 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:01.252984 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:01.253681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:01.254137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:01.254554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:01.451234 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:01.461887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a4efbc01-c4f5-4a1d-be6d-4a498c4bdded tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.268080 Sep 09 21:08:01.472119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 152/310] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:01 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:01.472447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:01.476667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1057cb85-32ac-4608-8afe-1015f756fd2b tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.238992 Sep 09 21:08:01.477231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 159/311] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:01 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:08:02.499387 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:02.500905 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:02.501538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:02.502149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:02.508998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:02.509726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:02.509858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:02.510207 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:02.510540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:02.510821 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:02.511528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:02.511968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:02.512125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:02.512556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:02.512681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:02.513240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:02.740933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:02.752542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-15b8147a-3371-42e1-b8a1-3770251154ba tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.253060 Sep 09 21:08:02.757017 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 160/312] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:02 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:02.759222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:02.770459 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e7caf5f1-0cad-4189-8aac-ed6f7ef22485 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.283528 Sep 09 21:08:02.771031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 153/313] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:02 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:03.774785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:03.776023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:03.782214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:03.782943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:03.783553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:03.784452 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:03.785053 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:03.792195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:03.794839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:03.794839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:03.809238 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:03.810114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:03.810807 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:03.812398 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:03.813217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:03.813866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:04.108723 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:04.125898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:04.130226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-40cb3355-cdf1-4510-8422-cdedb4ec0763 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.333075 Sep 09 21:08:04.136365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 154/314] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:03 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:04.137003 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-907a4fce-0c26-4965-ac1a-a2bafed87973 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1318 microversion: 2.1 time: 0.364793 Sep 09 21:08:04.144609 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 161/315] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:03 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:05.161037 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:05.161719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:05.162785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:05.164312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:05.168777 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:05.169266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:05.169694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:05.170598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:05.170830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:08:05.171035 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:05.171642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:05.173076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:05.173665 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:05.174341 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:05.175147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:05.176014 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:05.179174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:05.519323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:05.532404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8df032b5-4a65-4b5c-9c89-5610e77c8cfc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.375165 Sep 09 21:08:05.534238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:05.544596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:05 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:05.547300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-86bed245-dc26-4eb9-a45c-42a1a34ac8ae tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1507 microversion: 2.1 time: 0.385746 Sep 09 21:08:05.549962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 162/317] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:05 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1507 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:08:05.623290 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-8d3ecfec-45ce-485e-beae-b0564ede94fb req-64a786cb-0094-47b4-8422-d56a67974b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adcea70-5a82-48c8-9a07-54f1550e17f5", "name": "network-vif-plugged", "status": "completed", "tag": "499398d4-9eb5-4074-b98e-a0efaafdc265"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:08:05.657850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-8d3ecfec-45ce-485e-beae-b0564ede94fb req-64a786cb-0094-47b4-8422-d56a67974b79 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:05.658731 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-8d3ecfec-45ce-485e-beae-b0564ede94fb req-64a786cb-0094-47b4-8422-d56a67974b79 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:05.659544 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-8d3ecfec-45ce-485e-beae-b0564ede94fb req-64a786cb-0094-47b4-8422-d56a67974b79 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:05.723593 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-8d3ecfec-45ce-485e-beae-b0564ede94fb req-64a786cb-0094-47b4-8422-d56a67974b79 service nova] Creating event network-vif-plugged:499398d4-9eb5-4074-b98e-a0efaafdc265 for instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 on hv-cinder-83124 Sep 09 21:08:05.734261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-8d3ecfec-45ce-485e-beae-b0564ede94fb req-64a786cb-0094-47b4-8422-d56a67974b79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114239 Sep 09 21:08:05.735524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 156/318] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:08:06.579372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:06.579983 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:06.587216 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:06.587962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:06.588785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:06.590296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:06.590946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:06.591531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:06.801638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:06.810040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c923fe9e-2036-484c-8f3e-716586c81e1e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.235059 Sep 09 21:08:06.810608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 163/319] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:06 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:07.834456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:07.835173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:07.845341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:07.845829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:07.846284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:07.846987 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:07.847608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:07.848112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:08.056929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:08.068776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5867f503-ae54-492b-acae-fd45aa861f50 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1371 microversion: 2.1 time: 0.238495 Sep 09 21:08:08.077142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 157/320] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:07 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:09.093364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:09.094505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:09.102790 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:09.107737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:09.108571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:09.109852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:09.110731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:09.112695 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:09.300936 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:08:09.310296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fb8bde7d-384d-4d0b-87ea-e1cc5454dc0c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1564 microversion: 2.1 time: 0.221443 Sep 09 21:08:09.326835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 164/321] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:08:09 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:08:09.335486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:08:09.336194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:09.342687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:09.348088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:09.348947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:09.349914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:09.351200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:09.351819 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:09.447499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7f3515ab-2ed0-41ae-a37a-eb7a2640c91c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116418 Sep 09 21:08:09.448139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 158/322] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:08:09 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:08:11.294855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-f239088a-cff2-48b3-a161-5538adaae59d req-2db8f760-64db-492d-ba7a-b77446db8383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adcea70-5a82-48c8-9a07-54f1550e17f5", "tag": "499398d4-9eb5-4074-b98e-a0efaafdc265"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:08:11.310252 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-f239088a-cff2-48b3-a161-5538adaae59d req-2db8f760-64db-492d-ba7a-b77446db8383 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:11.311261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-f239088a-cff2-48b3-a161-5538adaae59d req-2db8f760-64db-492d-ba7a-b77446db8383 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:11.314076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-f239088a-cff2-48b3-a161-5538adaae59d req-2db8f760-64db-492d-ba7a-b77446db8383 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:11.331446 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-f239088a-cff2-48b3-a161-5538adaae59d req-2db8f760-64db-492d-ba7a-b77446db8383 service nova] Creating event network-changed:499398d4-9eb5-4074-b98e-a0efaafdc265 for instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 on hv-cinder-83124 Sep 09 21:08:11.339864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-f239088a-cff2-48b3-a161-5538adaae59d req-2db8f760-64db-492d-ba7a-b77446db8383 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045954 Sep 09 21:08:11.341522 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 165/323] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:08:13.562436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-81bb1d83-9ddc-4095-a861-39cc0bb27f99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Action: 'create', calling method: .version_select at 0x7fa1d0ba13a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-704010936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWatsiIQve/pCCujo7pvzj69oMnRw7auhAwUdfZgtxumXAgTJWIpXbv4bKJC7l0GxzMIRRJ5dAIkagDBYnCoveWVVS1sEk9SnS4HYMSV8mxsyFNNzm1b6IaR9uMAamDbg=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:08:13.579695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-81bb1d83-9ddc-4095-a861-39cc0bb27f99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:08:13.584166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-81bb1d83-9ddc-4095-a861-39cc0bb27f99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for user f289a1bdd79b4ba0bf9499edb7729c9a and project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:08:13.694291 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-81bb1d83-9ddc-4095-a861-39cc0bb27f99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.303779 Sep 09 21:08:13.694901 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 159/324] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:08:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:08:52.193751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=7 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:08:52.194591 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=51 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:08:52.199374 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f71098e-5abf-4253-8224-7c04613e524c", "device": "/dev/sdb"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:08:52.202457 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:08:52.208889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:52.209378 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:52.209842 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:52.210528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:08:52.210979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:08:52.211400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:08:52.998212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5089fddb-d5b0-40fa-856f-84cbe28a3114 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "POST /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805552 Sep 09 21:08:52.998911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 166/325] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:08:52 2022] POST /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:01.283972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=77 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:01.284765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=4 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:01.285403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:01.289886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:01.290368 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:01.297096 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:01.302668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:01.302668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:01.302668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:01.302668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:01.303053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:01.321391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-778e19c5-63c9-4ad8-9996-92123d97a83e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/ips" status: 200 len: 153 microversion: 2.20 time: 0.038944 Sep 09 21:09:01.321936 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 160/326] 10.222.0.48 () {60 vars in 1289 bytes} [Fri Sep 9 21:09:01 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:09:04.571837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:04.572662 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:04.576856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:04.577499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:04.585709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:04.591528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:04.591528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:04.591528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:04.591528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:04.591904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:04.611942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lazy-loading 'flavor' on Instance uuid d1900205-eef2-494e-b59c-a7ea601f4835 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:09:05.116173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c29a635a-340d-4096-a119-e228fa29c5f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/action" status: 202 len: 0 microversion: 2.20 time: 0.545771 Sep 09 21:09:05.116885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 167/327] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Sep 9 21:09:04 2022] POST /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:09:05.126118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:05.126729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:05.134055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:05.134571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:05.134994 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:05.135675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:05.136147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:05.136564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:05.268036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:05.276588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:05.278087 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:05.279476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-adf49066-7d43-49ae-b1a6-2b39dab47960 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.157999 Sep 09 21:09:05.280023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 161/328] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:05 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:05.760533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:05.761153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:05.768314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:05.768788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:05.769230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:05.769934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:05.770391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:05.770814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:05.794560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5a56970e-5fe5-4431-9473-288b7ab55346 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/ips" status: 200 len: 146 microversion: 2.1 time: 0.039090 Sep 09 21:09:05.795291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 168/329] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:09:05 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:06.310405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:06.311010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:06.317638 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:06.318116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:06.318622 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:06.319292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:06.319745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:06.320205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:06.450122 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:06.458451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:06.459929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:06.461098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4cea1736-afa0-4213-b8c2-4bccdfacd0bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.155768 Sep 09 21:09:06.461647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 162/330] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:06 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:06.628462 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1203892540", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-704010936", "security_groups": [{"name": "tempest-secgroup-smoke-27864544"}], "block_device_mapping_v2": [{"uuid": "c469fa5e-386f-4c78-81ec-7cdb9764590a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca317ead-021d-4181-81fb-569564a685ee"}]}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:06.746047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] validate_networks() for [('ca317ead-021d-4181-81fb-569564a685ee', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:09:07.145294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:09:07.145294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:09:07.145964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:09:07.145964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:09:07.146278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:09:07.155675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:07.156187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:07.156622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:07.157347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:07.157801 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:07.158224 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:07.174619 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:09:07.178600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for user f289a1bdd79b4ba0bf9499edb7729c9a and project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:09:07.236658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:09:07.238799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c469fa5e-386f-4c78-81ec-7cdb9764590a',volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:09:07.486391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:07.486993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:07.493153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:07.493630 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:07.494057 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:07.494768 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:07.495211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:07.495622 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:07.626023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:07.634422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:07.635887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:07.637809 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f4d6c5f9-564a-412f-946f-f6f6543ec713 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.154638 Sep 09 21:09:07.641802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 163/331] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:07 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:07.651489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-cf63b5b4-065c-4d33-941d-14898a56be00 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.026895 Sep 09 21:09:07.652440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 169/332] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:09:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:09:07.679651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a555f2e6-4231-428b-ae29-fe2f707dfdc8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:07.681141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a555f2e6-4231-428b-ae29-fe2f707dfdc8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:07.749243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a555f2e6-4231-428b-ae29-fe2f707dfdc8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:07.763606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a555f2e6-4231-428b-ae29-fe2f707dfdc8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1094 microversion: 2.1 time: 0.087762 Sep 09 21:09:07.764265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 164/333] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:07 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:08.666308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:08.666980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:08.674316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:08.676016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:08.676016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:08.676016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:08.676418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:08.676834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:08.787082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e98e6ea9-205d-4850-a3be-8a6037dc14c9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:08.790959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e98e6ea9-205d-4850-a3be-8a6037dc14c9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:08.813242 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:08.821654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:08.823100 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:08.824299 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c6a33652-e6f3-47a2-a1f6-cc761bcbbb8d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.162843 Sep 09 21:09:08.824885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 170/334] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:08 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:08.851533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e98e6ea9-205d-4850-a3be-8a6037dc14c9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:08.859965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e98e6ea9-205d-4850-a3be-8a6037dc14c9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1094 microversion: 2.1 time: 0.076960 Sep 09 21:09:08.860712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 165/335] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:08 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:09.849542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:09.850085 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:09.857640 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:09.858116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:09.858545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:09.859315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:09.864978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:09.864978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:09.883079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:09.883846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:09.894677 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:09.895393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:09.896191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:09.897102 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:09.897562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:09.897984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:09.981392 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:09.989297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3a23039d-8ec6-49ad-abe1-db5c439fc70d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1136 microversion: 2.1 time: 0.110264 Sep 09 21:09:09.989854 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 166/336] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:09 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1136 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:10.023800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:10.032159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:10.033653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:10.034803 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0cb9d23b-b6de-485e-9fbf-4b27ba32c05b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.189242 Sep 09 21:09:10.035351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 171/337] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:09 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:11.013198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:11.013845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:11.020112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:11.020595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:11.021026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:11.021712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:11.022161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:11.022581 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:11.060461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:11.061082 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:11.067969 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:11.071771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:11.071771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:11.071771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:11.071771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:11.072177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:11.085326 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:11.098310 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-23b4c4cd-f444-4c0d-badd-597b4991b1db tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1192 microversion: 2.1 time: 0.089353 Sep 09 21:09:11.098882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 167/338] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:11 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:11.203379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:11.211625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:11.217556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:11.217556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-afa4cba6-f387-4f6c-8aa9-3bb6ca1f3def tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.157733 Sep 09 21:09:11.217556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 172/339] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:11 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:12.120644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:12.121282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:12.127664 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:12.128172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:12.128605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:12.129304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:12.129806 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:12.130249 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:12.195033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:12.203063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f8cb35ca-3f51-4f8c-aa8f-2165d7514356 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1192 microversion: 2.1 time: 0.086536 Sep 09 21:09:12.203846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 168/340] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:12 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:12.238772 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:12.239638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:12.246469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:12.246953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:12.247389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:12.248113 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:12.248585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:12.248990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:12.376453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:12.386232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:12.388815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:12.390160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0f80e393-2f48-48e5-a836-56250c350c09 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.155393 Sep 09 21:09:12.390726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 173/341] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:12 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:13.226415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:13.227157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:13.233918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:13.234404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:13.234832 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:13.235518 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:13.235961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:13.236402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:13.296903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:13.304542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-aea0221b-9b41-4d3a-b77d-9994f51118a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1192 microversion: 2.1 time: 0.081998 Sep 09 21:09:13.305111 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 169/342] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:13 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:13.416757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:13.417372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:13.427149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:13.427149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:13.427149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:13.427149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:13.427514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:13.427514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:13.556657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:13.564661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:13.569422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:13.569422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dd81d99a-806e-4d02-bf8f-65555b069002 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.154378 Sep 09 21:09:13.569422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 174/343] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:13 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:14.328027 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:14.329197 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:14.335463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:14.335941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:14.336414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:14.337105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:14.337556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:14.337979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:14.399589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:14.407632 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b23a7792-8a16-4d63-b6dc-ea3fcac76b6d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1192 microversion: 2.1 time: 0.084246 Sep 09 21:09:14.420417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 170/344] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:14 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:14.592421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:14.593034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:14.603188 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:14.603677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:14.604147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:14.604897 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:14.605876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:14.606480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:14.770767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:14.779179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:14.780685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:14.784054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-36586139-0197-4652-8c08-41385cc4c878 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.193910 Sep 09 21:09:14.784054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 175/345] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:14 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:15.255085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d0daabc-4354-47c9-93af-a7eba6480b9b"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:15.257552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:15.263820 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:15.264516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:15.264947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:15.265642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:15.266091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:15.266534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:15.446763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:15.447389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:15.456131 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:15.459007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:15.459007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:15.459007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:15.459007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:15.459757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:15.637120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:15.644949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6ef120ef-e7eb-40b3-960e-eff03ebb127d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1276 microversion: 2.1 time: 0.217904 Sep 09 21:09:15.645804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 176/346] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:15 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:15.808937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:15.809542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:15.818846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:15.818846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:15.818846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:15.818846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:15.819231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:15.819231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:15.964521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:15.973451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:15.974896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:15.976123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-33bd7f6f-4e7c-4ce0-adb0-a4ea2a8617ed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.171102 Sep 09 21:09:15.976686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 177/347] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:15 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:16.255320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-32c8702e-fa7e-4e95-a52e-e3954a7ab17e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004182 Sep 09 21:09:16.255954 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 171/348] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:09:15 2022] POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:09:16.639527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-abc93200-91bc-4759-9975-b95e964fe7fc req-6a46ef5a-bdac-4d57-b0e3-be3582ccd96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc24ffe5-abae-40e0-95af-cd8318ed087b", "tag": "71413cdd-30b3-4d21-af8d-e26190318499"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:16.649289 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-abc93200-91bc-4759-9975-b95e964fe7fc req-6a46ef5a-bdac-4d57-b0e3-be3582ccd96a service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:16.649762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-abc93200-91bc-4759-9975-b95e964fe7fc req-6a46ef5a-bdac-4d57-b0e3-be3582ccd96a service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:16.650189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-abc93200-91bc-4759-9975-b95e964fe7fc req-6a46ef5a-bdac-4d57-b0e3-be3582ccd96a service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:16.661992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-abc93200-91bc-4759-9975-b95e964fe7fc req-6a46ef5a-bdac-4d57-b0e3-be3582ccd96a service nova] Creating event network-changed:71413cdd-30b3-4d21-af8d-e26190318499 for instance fc24ffe5-abae-40e0-95af-cd8318ed087b on hv-cinder-83124 Sep 09 21:09:16.666884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-abc93200-91bc-4759-9975-b95e964fe7fc req-6a46ef5a-bdac-4d57-b0e3-be3582ccd96a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Sep 09 21:09:16.668118 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 178/349] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:16.676263 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:16.676263 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:16.678252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:16.678928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:16.679162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:16.680010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:16.680490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:16.680908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:16.811910 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:16.819650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0d07016e-31b5-495e-bea6-e14c86889d7c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1276 microversion: 2.1 time: 0.154912 Sep 09 21:09:16.820232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 172/350] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:16 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:17.002973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:17.003657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:17.009826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:17.010301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:17.010725 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:17.011409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:17.012395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:17.012811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:17.136397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:17.144716 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:17.146188 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:17.147318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-090703ea-e3b0-4b2a-bcea-9dc6b40b624d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.148620 Sep 09 21:09:17.147864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 179/351] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:16 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:17.842928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:17.843471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:17.850293 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:17.850773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:17.851201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:17.851986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:17.852359 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:17.852805 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:17.987985 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:17.995716 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2c6ab5aa-4ab1-4c9d-b207-3aac033dc1f0 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1276 microversion: 2.1 time: 0.156806 Sep 09 21:09:17.996332 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 173/352] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:17 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:18.173638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:18.174247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:18.176191 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:18.176861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:18.182013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:18.186128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:18.186128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:18.186128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:18.186128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:18.186471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:18.313888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:18.322353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:18.323781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:18.325516 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-da42d79a-9de2-4822-983f-b4af9ab69277 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.155797 Sep 09 21:09:18.326061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 180/353] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:18 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:19.019048 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:19.019604 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:19.021980 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=4 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:19.026713 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:19.027220 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:19.031366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:19.031366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:19.031366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:19.031366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:19.154774 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:19.162299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ec5a2296-ba27-4a54-b7c5-8c0469d7cf27 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1276 microversion: 2.1 time: 0.147249 Sep 09 21:09:19.162845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 174/354] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:19 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:19.351280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:19.351826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:19.358687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:19.359165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:19.359598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:19.360310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:19.360762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:19.361181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:19.695998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:19.704487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:19.705981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:19.707140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d4c90699-6511-44a5-be9b-06ec2def24a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.359858 Sep 09 21:09:19.707838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 181/355] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:19 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:20.186526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:20.187072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:20.193465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:20.193940 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:20.194361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:20.195044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:20.195487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:20.195902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:20.321613 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:20.330180 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-dadb1e92-2892-4910-8cbe-bde6892d2c96 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1276 microversion: 2.1 time: 0.148272 Sep 09 21:09:20.330746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 175/356] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:20 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1276 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:20.733329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:20.745337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:20.745337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:20.745337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:20.745337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:20.745895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:20.745895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:20.745895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:20.885454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:20.893849 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:20.895722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:20.896915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f6de8432-445c-4782-8314-2cb1db7c758e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.168046 Sep 09 21:09:20.897469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 182/357] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:20 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:21.352996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:21.353574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:21.359960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:21.360472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:21.360911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:21.361597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:21.366975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:21.366975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:21.497024 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:21.504985 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ec4e606a-6748-4785-ab20-6eaf46ad3b44 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1276 microversion: 2.1 time: 0.156202 Sep 09 21:09:21.505651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 176/358] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:21 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:21.925099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:21.926420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:21.932899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:21.933580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:21.934007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:21.935370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:21.935815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:21.936258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:21.940397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:22.101464 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:22.110680 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:22.112232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:22.113458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-da2cdb03-a96c-4c84-93f0-6f975f0b81d4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.192578 Sep 09 21:09:22.115999 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 183/359] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:21 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:22.527305 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:22.527905 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:22.534733 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:22.535204 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:22.535630 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:22.536358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:22.536801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:22.537215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:22.555469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:22.677686 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:22.685403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6845601a-8f24-42b8-86f6-48bd9b411ed4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.161967 Sep 09 21:09:22.685971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 177/360] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:22 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:23.142241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:23.142847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:23.149180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:23.149654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:23.150082 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:23.150786 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:23.151236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:23.151647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:23.278528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:23.286396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:23.287834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:23.289003 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-58c5c255-fce4-40f2-b5eb-0543692660c6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.151755 Sep 09 21:09:23.289561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 184/361] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:23 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:23.710600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:23.710600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:23.716396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:23.717068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:23.717343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:23.727680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:23.727680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:23.727680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:23.858633 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:23.866526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-48b8159d-c6d1-4e3d-9059-1aa0898e07fb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.161709 Sep 09 21:09:23.867108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 178/362] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:23 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:24.314519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:24.315169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:24.321856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:24.322343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:24.322782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:24.323488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:24.323939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:24.324581 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:24.452594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:24.461255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:24.462818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:24.463983 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b59215cc-a04a-4323-9f65-a755bba8f1d6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.153538 Sep 09 21:09:24.464581 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 185/363] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:24 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:24.890486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:24.891005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:24.898139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:24.898751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:24.899231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:24.899932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:24.900414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:24.900839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:25.034459 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:25.042074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-da69418e-4b44-4bb8-ae84-1073f43171a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.156329 Sep 09 21:09:25.042627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 179/364] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:24 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:25.489838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:25.490476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:25.497132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:25.497672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:25.498120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:25.498864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:25.499368 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:25.499792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:25.635664 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:25.644057 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:25.645569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:25.646758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f98620a3-28af-42e3-b1e8-47ea34339060 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.160866 Sep 09 21:09:25.647321 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 186/365] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:25 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:26.065820 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:26.066468 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:26.072796 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:26.073271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:26.073698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:26.074379 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:26.074830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:26.075243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:26.203990 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:26.211481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-12b467dc-316d-45e9-a9fe-110f25e99366 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.149568 Sep 09 21:09:26.212028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 180/366] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:26 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:26.672747 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:26.673354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:26.679709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:26.680218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:26.680651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:26.681335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:26.681787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:26.682208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:26.817087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:26.825330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:26.827458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:26.828980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ca0067ac-e7b7-421e-a01b-2f3f0fbdf6ba tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.159869 Sep 09 21:09:26.829536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 187/367] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:26 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:27.236320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:27.236924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:27.243304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:27.243776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:27.244240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:27.244919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:27.245366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:27.245785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:27.372855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:27.381751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8a10752d-4f79-4043-a746-2974dfeae440 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.148891 Sep 09 21:09:27.383032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 181/368] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:27 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:27.858217 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:27.858803 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:27.866644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:27.867126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:27.867564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:27.868302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:27.868755 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:27.869174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:28.002236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:28.011092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:28.012520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:28.014226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3e25365e-b777-41e6-9272-354d947f8053 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.159420 Sep 09 21:09:28.014775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 188/369] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:27 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:28.405640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:28.406242 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:28.413712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:28.414907 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:28.415932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:28.416798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:28.417261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:28.417689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:28.548791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:28.556309 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-dd99b025-c6f7-4034-9f8a-690e17fe7514 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.155046 Sep 09 21:09:28.556864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 182/370] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:28 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:29.039627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:29.040282 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:29.047679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:29.048204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:29.048635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:29.049337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:29.049805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:29.050224 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:29.181255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:29.189246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:29.190697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:29.191851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8bc05552-02fe-4a26-a6fc-7b1feadf6531 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.156057 Sep 09 21:09:29.192442 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 189/371] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:29 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:29.579846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:29.580445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:29.586719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:29.587197 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:29.587624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:29.588334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:29.588784 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:29.589203 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:29.713828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:29.721993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-45e67018-4aaf-473e-aa9f-2363ef106972 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.146850 Sep 09 21:09:29.722546 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 183/372] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:29 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:30.217632 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:30.219037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:30.225771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:30.226264 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:30.226698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:30.227398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:30.227848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:30.228296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:30.364697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:30.372841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:30.374292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:30.375436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d7d91be0-5adf-46c1-9973-e8760e8410fa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.161975 Sep 09 21:09:30.375985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 190/373] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:30 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:30.745101 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:30.745715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:30.754057 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:30.754548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:30.754985 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:30.755695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:30.756205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:30.756615 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:30.911870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:30.919875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8c52a771-c58a-43f2-8204-d40da2dde9a5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.178574 Sep 09 21:09:30.920602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 184/374] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:30 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:31.400958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:31.401543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:31.408751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:31.409241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:31.409731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:31.410603 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:31.411403 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:31.412167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:31.557069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:31.565304 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:31.566759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:31.567869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-07b650cf-490d-43cd-8f4e-4a9aea4e80eb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.170798 Sep 09 21:09:31.568441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 191/375] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:31 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:31.945074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:31.945686 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:31.952145 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:31.953133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:31.953880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:31.954515 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:31.954988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:31.955400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:32.103644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:32.112146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b27e6795-3f90-44cd-9132-a1c2ae71f931 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.170859 Sep 09 21:09:32.112743 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 185/376] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:31 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:32.594231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:32.594960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:32.601471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:32.608052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:32.608052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:32.608052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:32.608052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:32.608975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:32.736653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:32.746281 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:32.747711 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:32.748884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ed347fea-11ee-44f7-ad90-65850e841655 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.158682 Sep 09 21:09:32.750020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 192/377] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:32 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:33.135970 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:33.136600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:33.143291 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:33.143923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:33.144398 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:33.145090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:33.145540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:33.145961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:33.277478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:33.285947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-700a0760-6bce-4ff4-8fd2-809cfee0e9d9 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.154065 Sep 09 21:09:33.286659 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 186/378] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:33 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:33.774918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:33.775533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:33.782256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:33.782738 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:33.783173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:33.783866 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:33.784407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:33.784829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:33.923223 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:33.931246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:33.932717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:33.933851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2b3ff91e-6af4-40d6-bcb2-d9c34dd13311 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.162947 Sep 09 21:09:33.934400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 193/379] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:33 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:34.308869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:34.309474 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:34.316345 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:34.316821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:34.317246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:34.317934 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:34.318374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:34.318789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:34.454337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:34.463373 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-062217ed-73dc-4ee6-acca-137e62c2b2d6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.158167 Sep 09 21:09:34.469535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 187/380] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:34 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:34.863650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:34.864180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:34.866436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:34.871075 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:34.871535 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:34.871964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:34.872680 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:34.873128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:34.873548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:34.960622 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:34.961505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:34.967522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:34.968681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:34.969320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:34.970023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:34.970832 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:34.971260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:35.003394 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lazy-loading 'services' on Instance uuid 06e076f0-cece-46e0-8e98-6310d871b07d {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:09:35.111675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:35.118389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:35.120749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:35.122663 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b5ac7e2d-7d40-4047-971f-692fb8884808 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.165686 Sep 09 21:09:35.123255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 188/381] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:34 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:35.250466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a5f83a9a-0763-4019-a09b-ea6af28faf2f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d/os-volume_attachments/8f71098e-5abf-4253-8224-7c04613e524c" status: 202 len: 0 microversion: 2.1 time: 0.390783 Sep 09 21:09:35.251053 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 194/382] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:09:34 2022] DELETE /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d/os-volume_attachments/8f71098e-5abf-4253-8224-7c04613e524c => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:09:35.488195 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:35.488802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:35.495357 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:35.495833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:35.496330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:35.497022 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:35.497465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:35.497880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:35.629736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:35.637259 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-56021dad-a10d-47e8-a0f0-fb429752401a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.152988 Sep 09 21:09:35.637818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 189/383] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:35 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:36.152119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:36.152822 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:36.159531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:36.160012 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:36.160467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:36.161157 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:36.161605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:36.162024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:36.291194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:36.299101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:36.301817 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:36.301817 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8a7ee4cb-c075-40b2-87b2-fd122e984ec0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.154608 Sep 09 21:09:36.302456 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 195/384] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:36 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:36.659961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:36.660584 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:36.662849 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=65 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:36.667464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:36.667943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:36.668410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:36.669103 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:36.669552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:36.669978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:36.799712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:36.807621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-805a83cb-81c0-4e24-80e8-32323b596a68 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.151493 Sep 09 21:09:36.808257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 190/385] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:36 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:37.326714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:37.327865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:37.334856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:37.335345 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:37.335832 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:37.336618 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:37.337072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:37.337495 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:37.476288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:37.484625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:37.486087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:37.487285 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-840dd718-b81b-46ac-ae8f-6f34be261e37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.164466 Sep 09 21:09:37.487846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 196/386] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:37 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:37.831516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:37.832135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:37.838583 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:37.839073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:37.842401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:37.842401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:37.842401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:37.842401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:37.976283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:37.984549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-64f1de6f-7979-470f-aed4-dbfacf8df9dd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.157051 Sep 09 21:09:37.985117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 191/387] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:37 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:38.512056 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:38.512678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:38.519983 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:38.520493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:38.520925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:38.521624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:38.522087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:38.522444 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:38.647607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:38.657187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:38.658777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:38.660081 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-30e310a2-8b97-49eb-a4f3-3d0a2fcf5ca0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.151712 Sep 09 21:09:38.660781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 197/388] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:38 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:38.850494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-d13eabf7-9b4d-470e-a12e-54bdf22acee7 req-4fb98960-bfea-43da-8540-c357fe5278b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "name": "network-vif-plugged", "status": "completed", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:38.860474 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-d13eabf7-9b4d-470e-a12e-54bdf22acee7 req-4fb98960-bfea-43da-8540-c357fe5278b6 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:38.860944 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-d13eabf7-9b4d-470e-a12e-54bdf22acee7 req-4fb98960-bfea-43da-8540-c357fe5278b6 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:38.861362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-d13eabf7-9b4d-470e-a12e-54bdf22acee7 req-4fb98960-bfea-43da-8540-c357fe5278b6 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:38.872249 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-d13eabf7-9b4d-470e-a12e-54bdf22acee7 req-4fb98960-bfea-43da-8540-c357fe5278b6 service nova] Creating event network-vif-plugged:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:09:38.877878 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-d13eabf7-9b4d-470e-a12e-54bdf22acee7 req-4fb98960-bfea-43da-8540-c357fe5278b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031081 Sep 09 21:09:38.878446 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 192/389] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:39.007907 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:39.008691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:39.015601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:39.016209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:39.016565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:39.017254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:39.017706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:39.018124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:39.148856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:39.156332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8fb49dc4-afbb-4a43-9c98-73f9da987494 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.152227 Sep 09 21:09:39.156902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 198/390] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:39 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:39.687300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:39.688020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:39.694020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:39.694495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:39.694969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:39.695655 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:39.696121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:39.696540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:39.826145 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:39.835406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:39.836962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:39.842726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e22fea83-f37d-4777-9d32-1741bc868ebc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.155771 Sep 09 21:09:39.842726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 193/391] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:39 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:40.179013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:40.179627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:40.186018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:40.187143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:40.187580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:40.188297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:40.188752 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:40.189172 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:40.193108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:40.315534 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:40.323143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-030a497c-53e4-4188-a685-7e508271e34f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.148007 Sep 09 21:09:40.323703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 199/392] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:40 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:40.749181 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9ed7d48c-8f24-4a57-8af6-c8947523b0bb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:40.755536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ed7d48c-8f24-4a57-8af6-c8947523b0bb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:40.756009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ed7d48c-8f24-4a57-8af6-c8947523b0bb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:40.756518 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ed7d48c-8f24-4a57-8af6-c8947523b0bb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:40.822895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9ed7d48c-8f24-4a57-8af6-c8947523b0bb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Going to try to stop instance {{(pid=121137) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 21:09:40.829955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:40.862847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:40.863466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:40.869475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:40.869965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:40.870398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:40.871096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:40.871547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:40.871971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:40.988307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9ed7d48c-8f24-4a57-8af6-c8947523b0bb tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action" status: 202 len: 0 microversion: 2.1 time: 0.242646 Sep 09 21:09:40.989284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 194/393] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:09:40 2022] POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:09:40.997722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:40.999709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:41.004735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:41.005260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:41.005702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:41.009037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:41.012583 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:41.013869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:41.013869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:41.018499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:41.020025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:41.021215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-572e2c5d-2346-460b-a338-db5f19248b52 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.162333 Sep 09 21:09:41.021764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 200/394] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:40 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:41.140098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:41.148224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c9e4505e-2c88-4afd-8004-b51b384c4e55 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.154740 Sep 09 21:09:41.148787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 195/395] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:40 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:41.345453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:41.345986 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:41.352297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:41.352776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:41.353206 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:41.353894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:41.354340 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:41.354756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:41.488259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:41.495833 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ea758133-c046-4680-bbac-7d1108aa623d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.154222 Sep 09 21:09:41.496426 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 201/396] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:41 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:42.047505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:42.048129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:42.054533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.055006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.055440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.056143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.056591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.057003 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.173330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:42.174019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:42.181819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.182867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.183373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.184331 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.184696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.188684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.192938 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:42.209513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:42.211020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:42.212750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3c55cee6-3f8a-440b-9326-e08778a9c718 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.169338 Sep 09 21:09:42.224130 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 196/397] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:42 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:42.331636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:42.339654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-34950b8f-4580-4542-9295-4e865786ec9e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.172166 Sep 09 21:09:42.340245 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 202/398] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:42 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:42.525067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:42.525702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:42.532100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.532597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.533032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.533724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.534179 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.534598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.663602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:42.671281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c9e655fb-50ad-4a07-a7fd-e0270d1f29b1 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.150082 Sep 09 21:09:42.671836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 197/399] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:42 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:42.740933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:42.741456 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:42.747876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.748388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.749390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.750083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:42.750536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:42.750954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:42.776621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:09:43.112994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-62cee594-7752-4174-b630-12eed1111c8e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 204 len: 0 microversion: 2.1 time: 0.375748 Sep 09 21:09:43.113585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 203/400] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:09:42 2022] DELETE /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:09:43.125453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:43.126063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:43.132575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.133119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.133545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.134223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.134669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.135082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.239761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:43.240607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:43.246543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.247103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.247547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.248278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.249332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.249760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.258330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:43.266066 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d4c619bb-ce78-4fba-9136-65112f3d7d3f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1513 microversion: 2.1 time: 0.145011 Sep 09 21:09:43.266550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 198/401] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:43 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:43.363380 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:43.363982 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:43.369964 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.370444 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.370862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.371543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.371995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.372439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.385093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:43.388124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:43.389589 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:43.390741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0342106f-e776-48f6-944f-0c49c7ac2532 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.155231 Sep 09 21:09:43.391286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 204/402] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:43 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:43.499125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:43.507114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-76b02461-326d-4600-a536-78ae0411ed43 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.147577 Sep 09 21:09:43.507656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 199/403] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:43 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:43.694641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:43.695253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:43.701241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.702229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.702666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.703354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:43.704061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:43.704502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:43.834357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:43.842047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5135c0f5-86d7-4e09-9393-74f0e4c1a08a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.151276 Sep 09 21:09:43.843267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 205/404] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:43 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:44.136399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-38f89430-676a-4a0e-b930-0e8251a6782a req-531efa18-8144-4c71-85ef-f7719f277b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc24ffe5-abae-40e0-95af-cd8318ed087b", "name": "network-vif-plugged", "status": "completed", "tag": "71413cdd-30b3-4d21-af8d-e26190318499"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:44.146926 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-38f89430-676a-4a0e-b930-0e8251a6782a req-531efa18-8144-4c71-85ef-f7719f277b99 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.147396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-38f89430-676a-4a0e-b930-0e8251a6782a req-531efa18-8144-4c71-85ef-f7719f277b99 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.147823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-38f89430-676a-4a0e-b930-0e8251a6782a req-531efa18-8144-4c71-85ef-f7719f277b99 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.158525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-38f89430-676a-4a0e-b930-0e8251a6782a req-531efa18-8144-4c71-85ef-f7719f277b99 service nova] Creating event network-vif-plugged:71413cdd-30b3-4d21-af8d-e26190318499 for instance fc24ffe5-abae-40e0-95af-cd8318ed087b on hv-cinder-83124 Sep 09 21:09:44.163277 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-38f89430-676a-4a0e-b930-0e8251a6782a req-531efa18-8144-4c71-85ef-f7719f277b99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030536 Sep 09 21:09:44.163830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 200/405] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:44.289056 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:44.289672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:44.296241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.296729 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.297165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.297852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.298305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.298727 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.417227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:44.417952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:44.423697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:44.424885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.425371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.425812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.426511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.426963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.427383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.431338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-eb5018e9-478b-4d60-b7ef-950a7aafe78c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1513 microversion: 2.1 time: 0.146311 Sep 09 21:09:44.431911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 206/406] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:44 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:44.529861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:44.530998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:44.536864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.537382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.537824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.538521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.538991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.539409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.553717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:44.561940 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:44.563387 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:44.564576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-aed20cf1-7ab1-433e-b1b1-739a2e4ee9b7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.151694 Sep 09 21:09:44.565121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 201/407] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:44 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:44.667858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:44.676182 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9ba540e0-124a-4cbb-b2f7-46f4af0549a9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.150210 Sep 09 21:09:44.676753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 207/408] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:44 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:44.865292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:44.865841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:44.871650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.872148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.872575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:44.873254 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:44.874245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:44.874661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.004967 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:45.013128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1ce58a5f-04a9-4926-a2ed-9e9e97f0cf23 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.151507 Sep 09 21:09:45.013733 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 202/409] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:44 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:45.454511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:45.455121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:45.461443 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:45.461922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:45.462353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.463034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:45.463482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:45.463901 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.590383 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:45.590766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:45.591369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:45.598383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:45.598545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5a1c2ff5-093d-4268-a110-7046ff9c3232 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1513 microversion: 2.1 time: 0.148076 Sep 09 21:09:45.598861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:45.599108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 208/410] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:45 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:45.599292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.600044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:45.600522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:45.600939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.698622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:45.699228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:45.705456 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:45.705946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:45.706380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.707073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:45.707524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:45.707946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:45.725843 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:45.734484 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:45.736054 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:45.737238 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-664ba543-0fb2-496c-9322-de8c544d2eed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.150412 Sep 09 21:09:45.737789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 203/411] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:45 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:45.834392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:45.843367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-779d87f4-6b50-406a-ac78-e5629883fe9c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.147717 Sep 09 21:09:45.843636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 209/412] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:45 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:46.035950 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:46.036591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:46.042452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.042933 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.043368 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.044053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.044528 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.044951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.172815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:46.180381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f90b1216-35b1-4fa7-91c9-c4a57b96e393 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.148388 Sep 09 21:09:46.180937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 204/413] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:46 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:46.621885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:46.622521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:46.628880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.629352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.629784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.630465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.630912 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.631331 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.754189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:46.761810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bc0865f8-d8ed-4e80-acfc-c433b894ad20 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1513 microversion: 2.1 time: 0.143700 Sep 09 21:09:46.762157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:46.762742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 210/414] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:46 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:46.762847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:46.769542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.770020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.770450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.771139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.771592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.772019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.866286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:46.868229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:46.872840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.873323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.873783 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.874479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:46.874934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:46.875356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:46.900000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:46.908794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:46.910233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:46.911384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c29deafb-4675-4202-9336-df1c08686e90 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1745 microversion: 2.20 time: 0.153218 Sep 09 21:09:46.911931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 205/415] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:46 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:46.998527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:47.006721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-434ea32b-7e08-4fab-9ca1-eb52229a4e2c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.144139 Sep 09 21:09:47.007220 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 211/416] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:46 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:47.208555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:47.209185 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:47.214922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:47.215394 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:47.215820 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:47.216520 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:47.216967 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:47.217410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:47.346386 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:47.354076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d73c007e-8b61-4d50-8ec8-863afcb4cd20 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1264 microversion: 2.1 time: 0.149447 Sep 09 21:09:47.354633 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 206/417] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:47 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:47.784063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:47.784764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:47.791054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:47.791534 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:47.791968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:47.792694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:47.793139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:47.793565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:47.919278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:47.927629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f03814e8-fa2e-4e4a-93eb-7303d11a5c15 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1513 microversion: 2.1 time: 0.147382 Sep 09 21:09:47.928215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 212/418] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:47 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:47.936173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:47.936783 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:47.943097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:47.943577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:47.944021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:47.944730 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:47.945178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:47.945598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.029054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:48.030177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:48.036044 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.036556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.036987 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.037675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.038155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.038574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.073647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:48.082055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:48.083599 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:48.084860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e23c65bc-b531-4305-8744-dd02db8e6801 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.152580 Sep 09 21:09:48.085491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 207/419] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:47 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:09:48.177980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:48.187679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7d1a6ff9-dee6-4a95-bd33-bb4e30779759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.162455 Sep 09 21:09:48.190014 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 213/420] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:48 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:48.377160 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:48.378135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:48.384638 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.385128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.385563 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.386255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.386763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.387187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.530906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:48.539303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ec7142ad-a9ee-46a5-87b5-24903647781d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1450 microversion: 2.1 time: 0.166534 Sep 09 21:09:48.539860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 208/421] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:48 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:48.562713 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:48.563325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:48.569270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.569763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.570191 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.570877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.571353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.571770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.575851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:48.658383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-cca2a1d3-2ac9-4bc5-b564-6b7234ec11a3 req-24273280-2f74-4e6f-b25a-48fb6b80167b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06e076f0-cece-46e0-8e98-6310d871b07d", "name": "network-vif-deleted", "tag": "2fc371e8-8d32-46a1-a568-93965a2dfe1e"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:48.672333 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-cca2a1d3-2ac9-4bc5-b564-6b7234ec11a3 req-24273280-2f74-4e6f-b25a-48fb6b80167b service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.672819 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-cca2a1d3-2ac9-4bc5-b564-6b7234ec11a3 req-24273280-2f74-4e6f-b25a-48fb6b80167b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.673248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-cca2a1d3-2ac9-4bc5-b564-6b7234ec11a3 req-24273280-2f74-4e6f-b25a-48fb6b80167b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.686515 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-cca2a1d3-2ac9-4bc5-b564-6b7234ec11a3 req-24273280-2f74-4e6f-b25a-48fb6b80167b service nova] Creating event network-vif-deleted:2fc371e8-8d32-46a1-a568-93965a2dfe1e for instance 06e076f0-cece-46e0-8e98-6310d871b07d on hv-cinder-83124 Sep 09 21:09:48.692056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-cca2a1d3-2ac9-4bc5-b564-6b7234ec11a3 req-24273280-2f74-4e6f-b25a-48fb6b80167b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039060 Sep 09 21:09:48.693093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 209/422] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:48.754939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:48.769377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a7c74355-bcb0-4cdf-8c4a-602ba632c647 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1450 microversion: 2.1 time: 0.210513 Sep 09 21:09:48.770357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 214/423] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:48 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1450 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:48.953855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:48.956841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:48.966826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.967781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.968596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:48.973274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:48.973274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:48.973274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:49.075175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:49.086846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-214c0ef1-6e70-4daa-ac82-e1d16b006f90 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1303 microversion: 2.1 time: 0.139187 Sep 09 21:09:49.087387 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 210/424] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:48 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:49.111250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:49.112656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:49.121949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:49.122787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:49.123379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:49.125161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:49.125932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:49.126551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:49.211456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:49.212104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:49.229178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:49.229669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:49.230282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:49.231140 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:49.234834 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:49.235490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:49.402246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:49.412991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:49.417829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:49.420694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bef140ec-df4d-4f24-972d-2244fb8784a7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.312190 Sep 09 21:09:49.420694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 215/425] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:49 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:49.528516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:49.532354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:49.541714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-368b0720-6614-455e-bac6-afe3ffb75eff tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.334751 Sep 09 21:09:49.542280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 211/426] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:49 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:50.113916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:50.114538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:50.125666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.130055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.131686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.133168 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.133856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.135437 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.189437 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.190967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.192332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.193785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lazy-loading 'fault' on Instance uuid 06e076f0-cece-46e0-8e98-6310d871b07d {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:09:50.244848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:50.255932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fa181400-8f68-48ae-937f-564061fbd991 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 200 len: 1308 microversion: 2.1 time: 0.148685 Sep 09 21:09:50.261684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 216/427] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:50 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:50.454620 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:50.457371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:50.467772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.468522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.469136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.470019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.470812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.472796 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.564571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:50.567428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:50.584307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.584805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.585233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.585957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:50.587869 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:50.589091 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:50.735381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:50.745869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:50.747727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:50.749677 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fab59f9a-94ef-4982-b9fc-514427533904 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.303196 Sep 09 21:09:50.750861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 212/428] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:50 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:50.812659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:50.821333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bc6f3499-4faf-4744-a7dc-e64df9d9175b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.260569 Sep 09 21:09:50.824793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 217/429] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:50 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:51.282759 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:51.283459 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: 06e076f0-cece-46e0-8e98-6310d871b07d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:51.295892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:51.296428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:51.296866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:51.297586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:51.300306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:51.300751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:51.321681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] HTTP exception thrown: Instance 06e076f0-cece-46e0-8e98-6310d871b07d could not be found. Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Request method failure captured: Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d HTTP/1.1 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6sdh3eOoCwMMP-Q8Wg14TbcN0X0fR0GbR2lSmUZu9RVOhJWRa2qT2m4uDgb6sf0battU0KaRMTGjWmigItMLJ9AXa_klk26NgEWCrUiRp9QNVFaadV-9ekJj0TTge4P-5EYXnyEzgX40qg5Qan7npps-oMopzLaRR2B0Fq1W6Txqf4 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: ce9d99ec2c254abaa341c4cab6f2c534 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1486706805 Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:09:51.323376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesSnapshotTestJSON-1486706805 Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: ce9d99ec2c254abaa341c4cab6f2c534 Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1486706805 Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesSnapshotTestJSON-1486706805-project Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 0d9129eaa2694ef6b3f006b67ef88c52 Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesSnapshotTestJSON-1486706805-project Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 06e076f0-cece-46e0-8e98-6310d871b07d could not be found. Sep 09 21:09:51.324844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '06e076f0-cece-46e0-8e98-6310d871b07d'} Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06e076f0-cece-46e0-8e98-6310d871b07d could not be found. Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:09:51.325665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06e076f0-cece-46e0-8e98-6310d871b07d could not be found. Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06e076f0-cece-46e0-8e98-6310d871b07d could not be found. Sep 09 21:09:51.327706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:09:51.329299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Returning 404 to user: Instance 06e076f0-cece-46e0-8e98-6310d871b07d could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:09:51.329299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c36bbd03-ae67-4653-b3af-e5a95bf17243 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d" status: 404 len: 111 microversion: 2.1 time: 0.046043 Sep 09 21:09:51.329299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 213/430] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:51 2022] GET /compute/v2.1/servers/06e076f0-cece-46e0-8e98-6310d871b07d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:09:51.779019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:51.780415 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:51.797357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:51.806873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:51.806873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:51.806873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:51.806873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:51.807305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:51.850906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:51.852191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:51.860371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:51.861092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:51.861766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:51.862637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:51.863517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:51.864207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:52.097950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:52.110851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:52.112635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:52.117220 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2221552e-234a-4eca-ad1e-5a0a87e82882 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.341971 Sep 09 21:09:52.122809 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 218/431] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:51 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:52.128109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-b4b8293f-903e-41f7-a76d-0df761f79119 req-711322f6-0ce9-4c78-a743-e8102cf322a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc24ffe5-abae-40e0-95af-cd8318ed087b", "tag": "71413cdd-30b3-4d21-af8d-e26190318499"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:09:52.149410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b4b8293f-903e-41f7-a76d-0df761f79119 req-711322f6-0ce9-4c78-a743-e8102cf322a4 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:52.156418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b4b8293f-903e-41f7-a76d-0df761f79119 req-711322f6-0ce9-4c78-a743-e8102cf322a4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:52.157111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b4b8293f-903e-41f7-a76d-0df761f79119 req-711322f6-0ce9-4c78-a743-e8102cf322a4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:52.181338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-b4b8293f-903e-41f7-a76d-0df761f79119 req-711322f6-0ce9-4c78-a743-e8102cf322a4 service nova] Creating event network-changed:71413cdd-30b3-4d21-af8d-e26190318499 for instance fc24ffe5-abae-40e0-95af-cd8318ed087b on hv-cinder-83124 Sep 09 21:09:52.189838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-b4b8293f-903e-41f7-a76d-0df761f79119 req-711322f6-0ce9-4c78-a743-e8102cf322a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064791 Sep 09 21:09:52.190079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:52.193791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 219/432] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:09:52.202715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c607791b-db5d-409c-bd49-bba1b6c79023 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.355522 Sep 09 21:09:52.203449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 214/433] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:51 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:53.148334 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:53.150844 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:53.160448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:53.164409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:53.164409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:53.164409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:53.164409 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:53.164771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:53.234007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:53.236002 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:53.245228 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:53.246137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:53.246811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:53.247991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:53.248933 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:53.249692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:53.381566 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:53.390674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:53.392473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:53.394257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-03547e08-3f52-4ee1-b3b3-615268b8adc8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.251000 Sep 09 21:09:53.395059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 220/434] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:53 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:53.457186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:53.465780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-30c7d2dd-f64c-4616-ab97-586ce70da5aa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.242150 Sep 09 21:09:53.472121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 215/435] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:53 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:54.422235 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:54.423532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:54.430075 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:54.430564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:54.431199 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:54.431928 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:54.432391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:54.433218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:54.493679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:54.495095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:54.502691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:54.503674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:54.504403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:54.505512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:54.506174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:54.506794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:54.654948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:54.666313 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:54.684261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:54.684261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c557fa78-d847-47c1-9675-bc498b4a4ee0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.251786 Sep 09 21:09:54.684261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 221/436] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:54 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:54.705572 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:54.716683 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-49a57644-7c33-4087-a3a6-f6784f5ace71 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.226791 Sep 09 21:09:54.718536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 216/437] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:54 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:55.696846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:55.697504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:55.705201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:55.705700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:55.706146 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:55.706859 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:55.707318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:55.707744 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:55.746485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:55.747787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:55.754989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:55.755483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:55.755924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:55.756678 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:55.757135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:55.757556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:55.890631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:55.898745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:55.900232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:55.901392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0f7bc1be-28b5-4f58-a553-ee70fbe929f7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.209186 Sep 09 21:09:55.901948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 222/438] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:55 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:55.919661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:55.927955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8c68e380-4720-49e7-a507-deba5b47d7e0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.189682 Sep 09 21:09:55.929537 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 217/439] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:55 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:56.927636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:56.928429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:56.936912 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:56.937937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:56.938453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:56.939247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:56.939777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:56.940239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:56.955084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:56.956085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:56.969053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:56.969602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:56.970017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:56.970730 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:56.971201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:56.971628 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:57.236783 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:57.247653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:57.247822 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:57.249471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:57.251005 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4d0dfcbb-cc2b-43b8-a66c-8c7715d2ceb9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.327466 Sep 09 21:09:57.251692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 223/440] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:56 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:57.260050 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0d39d636-96fa-4b6e-ac4b-d36e651c8093 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.309067 Sep 09 21:09:57.260962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 218/441] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:56 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:58.278806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:58.279440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:58.287487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:58.288214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:58.288833 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:58.289721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:58.290339 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:58.290933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:58.291960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:58.293425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:58.301754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:58.302241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:58.302674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:58.303458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:58.303910 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:58.304378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:58.589553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:58.600662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-74e22516-761b-4790-a11b-4e3c637f989c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.315247 Sep 09 21:09:58.601329 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 219/442] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:58 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:09:58.601504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:58.612720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:58.614414 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:58.615796 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e816b241-ff18-40e4-a9dd-b7fbfe848b0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.340937 Sep 09 21:09:58.616447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 224/443] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:58 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:09:59.625747 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:59.626162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:59.632333 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:59.632820 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:59.635232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:59.635232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:59.635232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:59.635232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:59.642773 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:09:59.643612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:09:59.651890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:59.651890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:59.652320 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:59.653289 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:09:59.654938 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:09:59.654938 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:09:59.844116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:59.852714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7c4bda4c-a9b3-4434-9a23-39d60e9cbe70 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.231263 Sep 09 21:09:59.853285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 220/444] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:09:59 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:09:59.853950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:59.862382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:59.863821 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:09:59.864985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8afe70cc-b95e-4cf1-8a5e-aec5555f38f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.227121 Sep 09 21:09:59.865526 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 225/445] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:09:59 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:10:00.875590 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:00.876157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:00.883150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:00.883642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:00.884095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:00.884825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:00.885277 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:00.885701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:00.915718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:00.916371 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:00.923058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:00.923538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:00.923966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:00.924677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:00.925124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:00.925540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:01.079201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:01.087591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-be2520ae-da10-4b43-b90b-9089805bcba6 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.216208 Sep 09 21:10:01.088412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 221/446] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:00 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:01.105421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:01.113643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:01.115077 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:01.116237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d1f9f297-80bb-40a7-8f59-1c31c08e01f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.204306 Sep 09 21:10:01.117636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 226/447] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:00 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:10:02.111043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:02.111680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:02.117977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:02.118450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:02.118878 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:02.119557 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:02.120001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:02.120444 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:02.142046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:02.143460 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:02.151011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:02.151815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:02.152256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:02.156974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:02.156974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:02.156974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:02.309222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:02.317647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9e236e58-d49c-4375-bcf9-487403ab66be tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1724 microversion: 2.1 time: 0.211069 Sep 09 21:10:02.318318 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 222/448] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:02 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:02.325588 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:02.333881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:02.335339 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:02.336511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-599c55c6-dc9e-422d-8e46-eeb7790223c0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.198413 Sep 09 21:10:02.337057 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 227/449] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:02 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:03.340872 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:03.342088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:03.348655 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.349395 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.349895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.350519 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.350951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.351376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.363434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:03.364644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:03.370626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.371104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.371786 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.372424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.372878 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.373296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.551951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:03.555750 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:03.560211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-205efe77-e3c1-4d40-9c80-192b35a3f23e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1701 microversion: 2.1 time: 0.223125 Sep 09 21:10:03.560768 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 223/450] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:03 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1701 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:03.564040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:03.565553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:03.566702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-66247814-64ad-425c-9974-0e5e80b156c3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1740 microversion: 2.20 time: 0.207772 Sep 09 21:10:03.567259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 228/451] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:03 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:10:03.582966 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e8026d6f-f067-4f3a-90b3-aeba45a1fa0f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:03.588765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e8026d6f-f067-4f3a-90b3-aeba45a1fa0f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.589181 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e8026d6f-f067-4f3a-90b3-aeba45a1fa0f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.589608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e8026d6f-f067-4f3a-90b3-aeba45a1fa0f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.611213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e8026d6f-f067-4f3a-90b3-aeba45a1fa0f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Going to try to start instance {{(pid=121137) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 21:10:03.783799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e8026d6f-f067-4f3a-90b3-aeba45a1fa0f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action" status: 202 len: 0 microversion: 2.1 time: 0.204729 Sep 09 21:10:03.784430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 224/452] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:10:03 2022] POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:10:03.792780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:03.793361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:03.799139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.799621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.800063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.800799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:03.801239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:03.801656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:03.933594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:03.946930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-db39e53a-cab7-4b7b-b1c6-027d437ffee1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.158081 Sep 09 21:10:03.947535 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 229/453] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:03 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:04.596929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:04.597980 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:04.608207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:04.609007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:04.609724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:04.610864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:04.611619 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:04.612389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:04.751239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:04.759628 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:04.761093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:04.762430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d4100d0a-25f5-4abc-a08e-49b2ce2af8a8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1722 microversion: 2.20 time: 0.173609 Sep 09 21:10:04.763011 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 225/454] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:04 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:04.971310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:04.973630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:04.976614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:04.987963 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:04.988611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:04.989169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:04.990104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:04.990750 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:04.991350 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:05.335520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:05.343830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e9db2400-5ce3-48e4-940c-534ddcb164e5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.376421 Sep 09 21:10:05.344452 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 230/455] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:04 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:05.789217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:05.789815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:05.796836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:05.797307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:05.797734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:05.798410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:05.798855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:05.799275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:05.927344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:05.935338 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:05.936793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:05.937937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bae690f4-8394-458a-9192-1ae04499329b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1722 microversion: 2.20 time: 0.152604 Sep 09 21:10:05.938485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 226/456] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:05 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:06.366621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:06.367235 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:06.373631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:06.374111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:06.374548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:06.375256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:06.375694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:06.376211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:06.380002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:06.501278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:06.509418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e066d2e4-bcfb-46ce-9d5b-84f48b6cd1c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.146659 Sep 09 21:10:06.509979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 231/457] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:06 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:06.962891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:06.963498 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:06.965916 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=74 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:06.970564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:06.971043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:06.971481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:06.972198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:06.972657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:06.973078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:07.096405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:07.104384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:07.105831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:07.107498 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5201d23e-d48a-45f4-aa5b-b828fb3cf4cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1722 microversion: 2.20 time: 0.148009 Sep 09 21:10:07.108054 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 227/458] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:06 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:07.532481 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:07.533021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:07.539291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:07.539768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:07.540235 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:07.540924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:07.541375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:07.541797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:07.666810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:07.675428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1087eac8-6cdc-4c1e-a233-bc408f455f4d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.147328 Sep 09 21:10:07.675994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 232/459] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:07 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:08.132654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:08.133312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:08.139648 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:08.140162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:08.140601 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:08.141289 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:08.141737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:08.142157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:08.146084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:08.272913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:08.282162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:08.283799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:08.284995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-356467c4-0c06-41ff-878a-d6851f87a03c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1722 microversion: 2.20 time: 0.156321 Sep 09 21:10:08.285516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 228/460] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:08 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:08.698479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:08.699092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:08.706306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:08.709083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:08.709083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:08.709083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:08.709083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:08.709435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:08.837980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:08.846819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8dc33b2a-662c-40fe-95a6-9f3b680dd780 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.152179 Sep 09 21:10:08.847397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 233/461] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:08 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:08.877812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-4e5c82b1-c2f9-4b82-b6ab-3a66a6df65f4 req-076a5e2f-5778-442e-8c5a-9156cf234577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "name": "network-vif-unplugged", "status": "completed", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:08.887400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4e5c82b1-c2f9-4b82-b6ab-3a66a6df65f4 req-076a5e2f-5778-442e-8c5a-9156cf234577 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:08.887863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4e5c82b1-c2f9-4b82-b6ab-3a66a6df65f4 req-076a5e2f-5778-442e-8c5a-9156cf234577 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:08.888871 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4e5c82b1-c2f9-4b82-b6ab-3a66a6df65f4 req-076a5e2f-5778-442e-8c5a-9156cf234577 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:08.899588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-4e5c82b1-c2f9-4b82-b6ab-3a66a6df65f4 req-076a5e2f-5778-442e-8c5a-9156cf234577 service nova] Creating event network-vif-unplugged:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:10:08.904711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-4e5c82b1-c2f9-4b82-b6ab-3a66a6df65f4 req-076a5e2f-5778-442e-8c5a-9156cf234577 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030470 Sep 09 21:10:08.905295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 229/462] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:10:09.311252 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:09.312107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:09.317782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:09.318265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:09.318703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:09.319398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:09.319853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:09.320407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:09.443512 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:09.451378 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:09.452851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:09.454253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b186742c-36f2-4750-acab-819b77fe2c18 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1722 microversion: 2.20 time: 0.147506 Sep 09 21:10:09.454802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 234/463] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:09 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:09.870603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:09.871452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:09.877488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:09.877969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:09.878402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:09.879091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:09.879548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:09.879972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:10.012040 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:10.020827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-474f3f28-bac4-41c0-a942-4d176279cb06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.155096 Sep 09 21:10:10.021420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 230/464] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:09 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:10.377134 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1765246289", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "networks": [{"uuid": "1be43f80-ec8e-4091-b48a-8be2b06a7edc"}]}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:10.434126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] validate_networks() for [('1be43f80-ec8e-4091-b48a-8be2b06a7edc', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:10:10.479198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:10.480180 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:10.487374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:10.487982 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:10.488530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:10.489327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:10.489875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:10.490465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:10.688727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:10.696847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:10.698414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:10.699635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a17eac19-6a8d-48f8-b6a0-8e0775aea440 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1722 microversion: 2.20 time: 0.225144 Sep 09 21:10:10.700296 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 231/465] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:10 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:10:10.849311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:10:10.849731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:10:10.853095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:10:10.853095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:10:10.853095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:10:10.860059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:10.860567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:10.860995 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:10.861713 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:10.862160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:10.862575 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:10.878900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Getting quotas for project ce9d99ec2c254abaa341c4cab6f2c534. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:10:10.882966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Getting quotas for user 0d9129eaa2694ef6b3f006b67ef88c52 and project ce9d99ec2c254abaa341c4cab6f2c534. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:10:10.894117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:10:10.896402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:10:11.011009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d6a5c67b-5dfa-44ce-8fda-7d1a99d6238e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638311 Sep 09 21:10:11.011814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 235/466] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:10:11.023572 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1a28e14a-3b49-4fa1-b7df-c92f0c4b1fc5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:11.024217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1a28e14a-3b49-4fa1-b7df-c92f0c4b1fc5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:11.044631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:11.045238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:11.051545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:11.052026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:11.052591 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:11.053286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:11.055321 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:11.055751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:11.085103 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1a28e14a-3b49-4fa1-b7df-c92f0c4b1fc5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:11.093223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1a28e14a-3b49-4fa1-b7df-c92f0c4b1fc5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1219 microversion: 2.1 time: 0.073443 Sep 09 21:10:11.093929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 232/467] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:11 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:11.196661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:11.209083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7651b655-7b4b-49db-a807-5f9eb3147112 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1710 microversion: 2.1 time: 0.168336 Sep 09 21:10:11.224293 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 236/468] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:11 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:10:11.727214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:11.727829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:11.736977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:11.737476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:11.737908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:11.740403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:11.740859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:11.746692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:11.883554 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:11.893210 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:11.894734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:11.895901 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-19d88ae7-7f38-41d9-b2a7-33587678d8f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1725 microversion: 2.20 time: 0.173050 Sep 09 21:10:11.896468 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 233/469] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:11 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:11.929992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c78d9e8-55d6-491c-9a86-8bdab794f31b"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:11.932442 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:11.939432 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:11.939920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:11.940411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:11.941103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:11.941555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:11.941974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:12.116459 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:12.117197 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:12.123904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:12.124410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:12.124835 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:12.125516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:12.125963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:12.126381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:12.190653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:12.198275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ea50f18e-626a-41fe-8e34-6a6078df05e4 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1223 microversion: 2.1 time: 0.085662 Sep 09 21:10:12.198821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 234/470] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:12 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:10:12.232031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:12.233238 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:12.239200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:12.239677 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:12.240177 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:12.240882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:12.241331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:12.241748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:12.375335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:12.383760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f79e331a-3f40-4d88-b615-ef7a7ca15995 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1714 microversion: 2.1 time: 0.155420 Sep 09 21:10:12.384356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 235/471] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:12 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:10:12.928666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a928658f-d776-449b-9d12-1472b90f4a9b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.002549 Sep 09 21:10:12.929308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 237/472] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Sep 9 21:10:11 2022] POST /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments => generated 188 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:10:13.065323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:13.065912 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:13.071657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:13.072168 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:13.072600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:13.073281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:13.073725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:13.074141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:13.118005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121137) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 21:10:13.222567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:13.223175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:13.230412 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:13.230898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:13.231333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:13.232023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:13.232490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:13.232908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:13.307550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:13.315909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-05f7938b-927d-4fb0-af14-f45c58593dfe tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1271 microversion: 2.1 time: 0.097072 Sep 09 21:10:13.316499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 238/473] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:13 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:10:13.423510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5ec8cbfc-36c5-4404-aaca-82abd89a8e0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/action" status: 202 len: 0 microversion: 2.20 time: 0.362019 Sep 09 21:10:13.424188 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 236/474] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Sep 9 21:10:13 2022] POST /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:10:13.432518 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:13.433211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:13.440559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:13.440973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:13.441435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:13.442135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:13.442576 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:13.443231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:13.609378 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:13.628174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:13.630400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:13.631574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-935ba47a-0fca-4a43-8792-40bb3ddf952c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1751 microversion: 2.20 time: 0.203276 Sep 09 21:10:13.635454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 239/475] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:13 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:10:14.339838 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:14.341094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:14.348165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:14.348655 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:14.349083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:14.349761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:14.350374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:14.350968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:14.498648 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:14.506653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1dd0ba4a-fb43-4666-9a6b-dead14e0f500 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.170726 Sep 09 21:10:14.521068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 237/476] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:14 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:14.661888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:14.663070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:14.670161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:14.671277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:14.671726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:14.672463 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:14.673153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:14.673751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:14.834435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:14.843449 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:14.849523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:14.849523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-799444ff-d173-4571-9e91-bbaa21ccfffa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1751 microversion: 2.20 time: 0.188576 Sep 09 21:10:14.849523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 240/477] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:14 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:15.299310 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-07911872-60a6-4b0f-b9fc-d8de7d7dd4a3 req-ff9e4f53-9d0f-4477-ad2c-2593d3822981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a509526a-cd3b-48b2-aa86-70185066ab2a", "tag": "bfaac92e-cfcf-497f-977c-6c12b636043f"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:15.309421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-07911872-60a6-4b0f-b9fc-d8de7d7dd4a3 req-ff9e4f53-9d0f-4477-ad2c-2593d3822981 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:15.310166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-07911872-60a6-4b0f-b9fc-d8de7d7dd4a3 req-ff9e4f53-9d0f-4477-ad2c-2593d3822981 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:15.311399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-07911872-60a6-4b0f-b9fc-d8de7d7dd4a3 req-ff9e4f53-9d0f-4477-ad2c-2593d3822981 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:15.323640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-07911872-60a6-4b0f-b9fc-d8de7d7dd4a3 req-ff9e4f53-9d0f-4477-ad2c-2593d3822981 service nova] Creating event network-changed:bfaac92e-cfcf-497f-977c-6c12b636043f for instance a509526a-cd3b-48b2-aa86-70185066ab2a on hv-cinder-83124 Sep 09 21:10:15.329597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-07911872-60a6-4b0f-b9fc-d8de7d7dd4a3 req-ff9e4f53-9d0f-4477-ad2c-2593d3822981 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Sep 09 21:10:15.330393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 238/478] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:10:15.531384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:15.532002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:15.538313 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:15.538807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:15.539236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:15.540004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:15.540492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:15.540917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:15.683726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:15.693437 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-25d089ce-16a9-4b10-8198-02a0f766f55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.165802 Sep 09 21:10:15.694000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 241/479] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:15 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:15.873428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:15.874175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:15.880183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:15.880753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:15.881184 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:15.881872 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:15.882321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:15.882740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:16.023897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:16.033061 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:16.034504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:16.035738 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-59b8d772-79dc-47f9-a287-2586b98b9b3f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.167793 Sep 09 21:10:16.036401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 239/480] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:15 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:16.716135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:16.716734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:16.723714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:16.724285 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:16.724718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:16.725398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:16.725875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:16.726330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:16.852098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:16.860010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1d27bf2d-6579-4e2d-b3f4-1d5c3aad8779 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.147707 Sep 09 21:10:16.860594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 242/481] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:16 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:17.062403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:17.063008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:17.069350 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:17.069823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:17.070252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:17.070938 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:17.071412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:17.071826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:17.197647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:17.206360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:17.207800 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:17.208969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0c6bafb6-0807-4ec9-bfcd-3d3bd87c7b42 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.151199 Sep 09 21:10:17.209512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 240/482] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:17 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:17.882587 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:17.883542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:17.890263 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:17.890743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:17.891183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:17.891879 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:17.892367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:17.892791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:18.021758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:18.029745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b934a55c-1408-424f-b989-277ce9177429 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.150748 Sep 09 21:10:18.031605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 243/483] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:17 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:18.234513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:18.235118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:18.241810 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:18.242321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:18.243025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:18.243644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:18.244116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:18.244594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:18.557128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:18.566203 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:18.567609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:18.568889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a3bed8ea-1f65-436b-993e-09d08f82b8d3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.338800 Sep 09 21:10:18.569466 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 241/484] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:18 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:19.052630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:19.053242 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:19.059554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:19.060030 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:19.061143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:19.061831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:19.062286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:19.062702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:19.236678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:19.244096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3037b489-d353-44e6-aa09-18210bc4c7d2 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.195323 Sep 09 21:10:19.244661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 244/485] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:19 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:19.594830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:19.595443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:19.601772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:19.602248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:19.602700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:19.603365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:19.603815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:19.604278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:19.732960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:19.741471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:19.742910 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:19.744095 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-109528f2-e5a6-47b2-9649-f8c6c8f0788a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.153707 Sep 09 21:10:19.744660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 242/486] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:19 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:20.267523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:20.268094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:20.274560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:20.275048 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:20.275490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:20.276215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:20.276675 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:20.277107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:20.404355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:20.407728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:20.412335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3cc6f29c-7ad5-4952-b022-c0dab9bc2e65 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.149324 Sep 09 21:10:20.412889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 245/487] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:20 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:20.769315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:20.769921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:20.776226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:20.776702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:20.777129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:20.777811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:20.778258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:20.778677 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:20.903702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:20.912691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:20.914134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:20.915310 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-48ca9678-308a-4f0c-9208-d1e4dd07d316 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.149902 Sep 09 21:10:20.915871 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 243/488] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:20 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:21.435152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:21.435794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:21.437962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:21.438652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:21.444185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:21.444663 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:21.445092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:21.445794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:21.446208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:21.446621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:21.572483 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:21.580997 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c0e28282-d050-4bf7-8e93-ff670b81dbd9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.149772 Sep 09 21:10:21.581554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 246/489] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:21 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:21.941801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:21.942409 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:21.944356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:21.949196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:21.949674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:21.950157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:21.950802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:21.951829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:21.952285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:22.090432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:22.098936 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:22.100429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:22.101614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8d9a85aa-4f4f-460a-8055-272bd8186d1d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.164003 Sep 09 21:10:22.102163 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 244/490] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:21 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:22.603270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:22.603880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:22.610627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:22.611107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:22.611542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:22.612261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:22.612717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:22.613167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:22.737099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:22.744793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b9cddbb3-aacd-4ccf-a527-03e3320abde9 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.145401 Sep 09 21:10:22.745352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 247/491] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:22 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:23.133860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:23.134470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:23.141504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:23.141987 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:23.142424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:23.143118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:23.143601 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:23.144030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:23.272302 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:23.280790 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:23.282248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:23.283417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8db6ea8a-6b6f-432d-bcec-3a7038f005f6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.153473 Sep 09 21:10:23.283966 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 245/492] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:23 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:23.766643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:23.767263 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:23.774142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:23.774529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:23.774953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:23.775656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:23.776148 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:23.776604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:23.904921 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:23.913478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ddee41df-2462-4d2c-a9cb-74f73de4ddea tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.150652 Sep 09 21:10:23.914052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 248/493] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:23 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:24.308780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:24.309390 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:24.315935 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:24.316444 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:24.316870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:24.317555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:24.318002 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:24.318417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:24.322452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:24.457756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:24.466891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:24.471984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:24.471984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-defd3f72-3958-4f19-8ce7-2bee533002bd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1753 microversion: 2.20 time: 0.164785 Sep 09 21:10:24.471984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 246/494] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:24 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:24.937850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:24.938529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:24.945284 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:24.945769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:24.946243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:24.946940 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:24.947490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:24.947918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:25.079316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:25.086897 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f8d756c7-3a0b-42d9-8add-16e20c996395 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.153934 Sep 09 21:10:25.088554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 249/495] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:24 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:25.495896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:25.496527 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:25.503644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:25.504148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:25.504576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:25.505254 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:25.505699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:25.506115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:25.630662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:25.639064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:25.641149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:25.642327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5a917cae-0314-42a9-98fc-8ea6f7abc55b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.150991 Sep 09 21:10:25.642877 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 247/496] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:25 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:26.110569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:26.111186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:26.117604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:26.118079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:26.118514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:26.119203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:26.119649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:26.120092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:26.246559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:26.254015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8c755963-b167-40aa-85d8-d65da931c637 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.147979 Sep 09 21:10:26.254579 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 250/497] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:26 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:26.667424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:26.668022 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:26.674392 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:26.674869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:26.675302 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:26.675976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:26.676460 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:26.676873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:26.800432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:26.808892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:26.817984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:26.817984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-cd7bdc80-5987-493a-b2e1-5fe2a93ee159 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.147944 Sep 09 21:10:26.817984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 248/498] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:26 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:27.276492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:27.277043 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:27.283993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:27.284513 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:27.284945 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:27.285637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:27.286093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:27.286518 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:27.412197 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:27.419646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a20f8ea7-b0a4-4374-bbaf-c4d5e211c7e5 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.147095 Sep 09 21:10:27.420231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 251/499] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:27 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:27.842424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:27.843044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:27.849401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:27.849880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:27.850321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:27.851041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:27.851488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:27.851911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:27.977538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:27.987000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:27.988476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:27.989642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f4412da6-c378-4807-8571-e4e994bcac19 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151159 Sep 09 21:10:27.990194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 249/500] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:27 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:28.442146 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:28.442787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:28.449179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:28.449660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:28.450098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:28.450797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:28.451249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:28.451670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:28.574748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:28.582578 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6aa32d6d-b095-44ff-b7fc-ac6e03328b99 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.144293 Sep 09 21:10:28.583138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 252/501] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:28 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:29.014566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:29.015181 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:29.021505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:29.021981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:29.022410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:29.023093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:29.023547 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:29.023964 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:29.150993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:29.160094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:29.161532 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:29.162693 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7e333d93-a80e-4214-b568-e05a0fece215 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151956 Sep 09 21:10:29.163246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 250/502] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:29 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:29.605821 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:29.614612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:29.614612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:29.614612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:29.614954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:29.615615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:29.616092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:29.616534 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:29.744401 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:29.752126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3cac5d23-78e3-4001-87d4-0c6e72b18194 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.150245 Sep 09 21:10:29.752695 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 253/503] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:29 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:30.189517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:30.190149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:30.196686 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:30.197050 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:30.197487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:30.198151 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:30.198592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:30.199006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:30.344346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:30.353591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:30.355023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:30.356206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-18b3382c-6563-4ca4-a7e5-e76c32d2c259 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.171257 Sep 09 21:10:30.356744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 251/504] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:30 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:30.430533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-baf369e0-599b-455f-8f23-3f282a6ca71a req-617d3009-f4cb-44b1-8cdf-a094ddab3b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a509526a-cd3b-48b2-aa86-70185066ab2a", "name": "network-vif-plugged", "status": "completed", "tag": "bfaac92e-cfcf-497f-977c-6c12b636043f"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:30.441079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-baf369e0-599b-455f-8f23-3f282a6ca71a req-617d3009-f4cb-44b1-8cdf-a094ddab3b67 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:30.441488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-baf369e0-599b-455f-8f23-3f282a6ca71a req-617d3009-f4cb-44b1-8cdf-a094ddab3b67 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:30.442008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-baf369e0-599b-455f-8f23-3f282a6ca71a req-617d3009-f4cb-44b1-8cdf-a094ddab3b67 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:30.454777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-baf369e0-599b-455f-8f23-3f282a6ca71a req-617d3009-f4cb-44b1-8cdf-a094ddab3b67 service nova] Creating event network-vif-plugged:bfaac92e-cfcf-497f-977c-6c12b636043f for instance a509526a-cd3b-48b2-aa86-70185066ab2a on hv-cinder-83124 Sep 09 21:10:30.460450 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-baf369e0-599b-455f-8f23-3f282a6ca71a req-617d3009-f4cb-44b1-8cdf-a094ddab3b67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033307 Sep 09 21:10:30.461032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 254/505] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:10:30.776774 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:30.778749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:30.793930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:30.794427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:30.795064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:30.796538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:30.796998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:30.797446 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:30.966741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:30.975651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9c027e81-3319-47cd-a78e-566628df48fc tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.204076 Sep 09 21:10:30.976250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 252/506] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:30 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:31.384183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:31.385357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:31.392117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:31.392807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:31.393447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:31.394152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:31.394612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:31.395040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:31.534004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:31.542549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:31.544005 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:31.545189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dc408f95-5698-4083-821d-7efacaa75072 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.166236 Sep 09 21:10:31.545787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 255/507] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:31 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:32.006374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:32.007174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:32.015350 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:32.016105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:32.016643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:32.017450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:32.017997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:32.018534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:32.153258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:32.162748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f2928d53-5ed4-448f-95b0-94ecf94bb6c7 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.167144 Sep 09 21:10:32.163877 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 253/508] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:31 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:32.571001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:32.571621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:32.580515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:32.581054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:32.581493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:32.582214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:32.582881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:32.583316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:32.724646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:32.733967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:32.735438 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:32.736650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2628d18d-5df2-4173-a1be-74330b5eb166 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.169675 Sep 09 21:10:32.737397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 256/509] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:32 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:33.187448 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:33.188061 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:33.194529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:33.195003 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:33.195527 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:33.196241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:33.196686 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:33.197104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:33.333078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:33.340847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6c727cae-2a07-4cef-93e8-9989551ffb75 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.158009 Sep 09 21:10:33.341405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 254/510] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:33 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:33.762722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:33.763332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:33.769849 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:33.770326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:33.770761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:33.771446 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:33.771899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:33.772347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:33.898693 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:33.908086 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:33.909588 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:33.910749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6b9949b5-0c13-407d-8ea3-0377a2ec7981 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151909 Sep 09 21:10:33.911337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 257/511] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:33 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:34.363566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:34.364109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:34.370596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:34.371080 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:34.371516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:34.372279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:34.372734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:34.373167 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:34.499979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:34.507495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-795cec70-5a67-4002-bd8a-a38b2d57063d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.147939 Sep 09 21:10:34.508048 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 255/512] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:34 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:35.055824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:35.057072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:35.059195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:35.064238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:35.064738 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:35.065179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:35.065902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:35.066427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:35.066790 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:35.202276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:35.212378 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:35.213830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:35.215032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9a834149-1025-41d0-a6c0-c30717d3a9f1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.283790 Sep 09 21:10:35.215593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 258/513] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:34 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:35.530897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:35.531507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:35.537875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:35.538355 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:35.538788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:35.539476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:35.539924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:35.540375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:35.673151 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:35.681353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f7f540f9-8436-45ac-96ff-5c49fbe6bafa tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.154742 Sep 09 21:10:35.696696 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 256/514] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:35 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:36.241949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:36.242555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:36.248934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:36.249414 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:36.249895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:36.250712 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:36.251195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:36.251631 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:36.402487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:36.411769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:36.413250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:36.414797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-82acf831-78ef-48a1-b607-9e87cc637795 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.176404 Sep 09 21:10:36.415563 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 259/515] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:36 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:36.705456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:36.706099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:36.712846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:36.713335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:36.713836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:36.714558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:36.715006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:36.715422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:36.873371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:36.881054 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b99c493f-fb83-4f6c-873b-49f7f8702e0f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.179814 Sep 09 21:10:36.881616 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 257/516] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:36 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:37.441965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:37.442580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:37.449100 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:37.449586 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:37.450025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:37.450715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:37.451171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:37.451596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:37.577441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:37.587187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:37.588668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:37.589824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-561a98fc-341f-49be-a366-7fc7f86d478b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151790 Sep 09 21:10:37.590369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 260/517] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:37 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:37.904773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:37.906825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:37.909533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:37.914487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:37.914969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:37.915401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:37.916133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:37.916590 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:37.917012 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:38.053799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:38.061562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-92bf780f-0728-4054-91aa-4e932c43557d tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.161785 Sep 09 21:10:38.062341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 258/518] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:37 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:38.614753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:38.615364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:38.623215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:38.623215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:38.623215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:38.623215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:38.623668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:38.624110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:38.777428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:38.790468 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:38.792236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:38.793655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1583d1ad-ba29-4657-b68f-6fdcfd895a0e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.182749 Sep 09 21:10:38.794333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 261/519] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:38 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:39.087750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:39.089395 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:39.097388 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:39.098138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:39.098933 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:39.099822 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:39.100455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:39.101299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:39.238275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:39.248372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3f166254-9bb6-40b9-8d0c-89481f986e01 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.167536 Sep 09 21:10:39.248969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 259/520] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:39 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:39.822761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:39.823443 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:39.831187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:39.831643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:39.832094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:39.832779 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:39.833229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:39.833647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:39.963002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:39.975502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:39.982943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:39.984305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d947b533-e4e2-4f1b-b362-34b727b96e17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.165323 Sep 09 21:10:39.985072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 262/521] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:39 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:40.274464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:40.275041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:40.281280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:40.281751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:40.282174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:40.282850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:40.283292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:40.283706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:40.411363 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:40.418837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-79c266fa-dd9f-4772-94f1-9b9397cefc14 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.148337 Sep 09 21:10:40.419393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 260/522] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:40 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:41.016328 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:41.017116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:41.023992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:41.025371 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:41.025892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:41.026682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:41.027327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:41.027764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:41.033512 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:41.177050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:41.186366 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:41.187836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:41.189058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-19128925-2ef3-4617-8bb9-383078d8853f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.182524 Sep 09 21:10:41.189627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 263/523] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:41 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:41.441143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:41.441737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:41.444634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:10:41.444775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Fri Sep 9 21:10:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a (ip 10.222.0.48) !!! Sep 09 21:10:41.451154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:41.451635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:41.452082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:41.453337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:41.454074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:41.454494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:41.581370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:41.589094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-243bfd3d-f593-42a9-9b3b-77daa7d6261e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.151872 Sep 09 21:10:41.589651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 261/524] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:41 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:42.215268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:42.215880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:42.222889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:42.223397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:42.223835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:42.224555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:42.225004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:42.225425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:42.376439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:42.385274 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:42.387079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:42.388532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fe804172-a990-4d8b-a61d-6e2f6829b46c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.177277 Sep 09 21:10:42.389151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 264/525] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:42 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:42.612495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:42.613193 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:42.619813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:42.620327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:42.620765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:42.621487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:42.621933 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:42.622346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:42.754957 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:42.758735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:10:42.763888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a376a3d8-afe1-413b-b979-4e786fe88fe8 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.155454 Sep 09 21:10:42.775262 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 262/526] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:42 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:43.414835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:43.415441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:43.422427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:43.422905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:43.423334 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:43.424014 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:43.424488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:43.424905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:43.557993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:43.567141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:43.568701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:43.569861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d99e4d93-98dd-4349-963e-df5a6a8cdfeb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.158957 Sep 09 21:10:43.570405 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 265/527] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:43 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:43.788324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:43.789024 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:43.795815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:43.796840 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:43.797276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:43.797977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:43.798422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:43.798837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:43.925737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:43.933854 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-021307ca-b7bf-4e07-bd24-14aa8b506265 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.149787 Sep 09 21:10:43.934411 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 263/528] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:43 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:44.599654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:44.600434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:44.603132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:10:44.603280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Fri Sep 9 21:10:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 (ip 10.222.0.48) !!! Sep 09 21:10:44.615505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:44.615991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:44.616654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:44.617356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:44.618320 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:44.618320 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:44.751548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:44.761831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:44.763327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:44.764517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ce30dcb3-9ecb-4d89-b62d-7fa2569932b2 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.171513 Sep 09 21:10:44.776360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 266/529] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:44 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:44.958396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:44.959004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:44.966209 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:44.968986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:44.968986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:44.968986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:44.968986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:44.969358 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:45.104685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:45.113386 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3b7ecd02-77bf-42cc-ad32-d4e799cf329f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.158956 Sep 09 21:10:45.117852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 264/530] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:44 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:45.804281 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:45.806160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:45.814987 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:45.825804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:45.825804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:45.825804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:45.825804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:45.826228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:45.952286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:45.961920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:45.963654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:45.965104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6d1d7916-d155-43c0-862e-701f114884ee tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.165852 Sep 09 21:10:45.966325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 267/531] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:45 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:46.137187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:46.137834 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:46.144261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:46.144963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:46.145441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:46.146306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:46.146917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:46.147334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:46.278962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:46.287114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8c593c5d-efee-4a3d-8f00-e776652ed55c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.154110 Sep 09 21:10:46.287671 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 265/532] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:46 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:46.990851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:46.991561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:46.997838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:46.999599 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:46.999599 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:46.999992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:47.000472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:47.000896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:47.133337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:47.142807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:47.144373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:47.145551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dd5c7f9e-6a24-4ffd-bfd8-fb425b567d21 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.158644 Sep 09 21:10:47.146115 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 268/533] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:46 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:47.310429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:47.311048 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:47.317466 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:47.317956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:47.318388 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:47.319085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:47.319538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:47.319961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:47.455934 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:47.461198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-eb7d7fb4-4935-4e86-8723-66aa2de6a57c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.154602 Sep 09 21:10:47.461761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 266/534] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:47 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:48.170742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:48.171355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:48.177659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:48.180105 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:48.180105 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:48.180105 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:48.180105 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:48.180470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:48.310684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:48.318993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:48.326150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:48.326150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-af052a59-44a2-4f79-9209-afaed5e10aaf tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.154870 Sep 09 21:10:48.326150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 269/535] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:48 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:48.485455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:48.486186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:48.492999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:48.493580 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:48.494046 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:48.494760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:48.495210 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:48.495633 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:48.624799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:48.632740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c7ba321e-799b-49d7-8de4-e965a85042bf tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.151771 Sep 09 21:10:48.633300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 267/536] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:48 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:10:49.349920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:49.350463 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:49.356798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:49.357274 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:49.357704 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:49.359054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:49.359507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:49.359922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:49.484032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:49.492499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:49.493947 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:49.495090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8b9d71a7-6f2c-4d74-ab2e-cd753f2e2cfd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.149181 Sep 09 21:10:49.495643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 270/537] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:49 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:49.656610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:49.657214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:49.663740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:49.664247 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:49.664675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:49.665357 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:49.665804 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:49.666219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:49.789562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:49.797047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-cdda8299-ab62-4441-a4ac-190ca560f127 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.144908 Sep 09 21:10:49.797594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 268/538] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:49 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:50.520112 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:50.520733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:50.527211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:50.527691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:50.528157 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:50.528850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:50.529303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:50.529728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:50.655560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:50.664092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:50.665553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:50.666715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9f9a7c4d-3e68-4875-afa8-aa3307c43132 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.150559 Sep 09 21:10:50.667275 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 271/539] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:50 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:50.819386 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:50.820001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:50.826482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:50.828109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:50.828109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:50.829026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:50.829483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:50.829903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:50.954782 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:50.962400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bf1b86d8-cbf6-4200-9d7f-8710b0d4ede1 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.146894 Sep 09 21:10:50.962963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 269/540] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:50 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:51.692739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:51.693348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:51.699944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:51.700461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:51.700895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:51.701580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:51.702065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:51.702491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:51.848476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:51.857028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:51.859146 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:51.860331 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0512bcc4-284f-4dd1-b1a4-cfa3befdf20f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.171503 Sep 09 21:10:51.863874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 272/541] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:51 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:51.985124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:51.985761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:51.991610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:51.992114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:51.992544 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:51.993230 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:51.993675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:51.994090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:52.123250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:52.130828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b1e23b70-cc26-4394-ac3e-c32c0b76384e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.149791 Sep 09 21:10:52.131382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 270/542] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:51 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:52.885424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:52.885977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:52.893021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:52.893508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:52.893949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:52.894641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:52.895123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:52.895544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:53.029302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:53.038149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:53.039711 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:53.040972 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-644e4b0e-2029-44e9-b2ca-b4aa05545f33 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.159519 Sep 09 21:10:53.041532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 273/543] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:52 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:53.153607 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:53.154219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:53.160740 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:53.161214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:53.161640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:53.162322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:53.162766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:53.163183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:53.285528 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:53.292992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-db7b7adc-6f04-4ec9-ab04-13746f660b83 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.143276 Sep 09 21:10:53.293574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 271/544] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:53 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:54.066756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:54.067360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:54.073849 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:54.074329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:54.074762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:54.075510 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:54.076049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:54.076491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:54.202139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:54.211020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:54.212492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:54.213639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9516230d-4a90-45e7-8d64-a2b7e02c2aed tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151365 Sep 09 21:10:54.214190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 274/545] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:54 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:54.316284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:54.316896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:54.323231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:54.323711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:54.324198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:54.324894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:54.325347 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:54.325772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:54.462718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:54.470877 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d8b0ddd3-5dbd-48c4-9775-b8491897b66e tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1319 microversion: 2.1 time: 0.159456 Sep 09 21:10:54.471439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 272/546] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:54 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:10:55.239716 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:55.240334 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:55.246699 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:55.247177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:55.247609 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:55.248321 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:55.248769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:55.249187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:55.376161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:55.384645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:55.386095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:55.387282 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d91dd9fd-9ebe-4ccb-9187-aaf90a17857d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151517 Sep 09 21:10:55.387834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 275/547] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:55 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:55.493273 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:55.493884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:55.500385 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:55.500866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:55.501304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:55.501994 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:55.502445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:55.502865 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:55.628302 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:55.635886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c369a56b-cb1f-4ce2-85c7-58d7f034b6ff tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1508 microversion: 2.1 time: 0.146498 Sep 09 21:10:55.636487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 273/548] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:10:55 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:10:55.659245 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6635ccde-d965-4d8c-9513-5640fc817f94", "device": "/dev/sdb"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:10:55.661747 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:55.667644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:55.668170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:55.668613 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:55.669301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:55.669759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:55.670183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:56.377603 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c89cd77a-6354-4c2a-ba65-3145d4245963 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "POST /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722674 Sep 09 21:10:56.378300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 276/549] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:10:55 2022] POST /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:10:56.412853 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:56.413147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:56.419053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:56.419536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:56.419971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:56.420690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:56.421148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:56.423372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:56.548744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:56.557424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:56.558885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:56.560088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6e5274cb-d9a9-4005-892a-e41455e6b4e8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151427 Sep 09 21:10:56.560648 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 274/550] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:56 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:57.586437 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:57.587128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:57.593208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:57.593686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:57.594119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:57.594808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:57.595261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:57.595683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:57.718877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:57.727331 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:57.728812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:57.729967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-969c8b27-bb9a-4bdf-977d-2d1d85f52aa3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.148271 Sep 09 21:10:57.730524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 277/551] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:57 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:58.755031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:58.755642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:58.762099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:58.762581 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:58.763011 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:58.763697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:58.764170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:58.764594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:58.891636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:58.900229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:58.901674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:10:58.902833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b96a6d08-8b91-44ad-b369-8ebf999c15a6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151741 Sep 09 21:10:58.903389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 275/552] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:58 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:10:59.928653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:10:59.929270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:10:59.935608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:59.941570 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:59.941570 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:59.941570 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:10:59.941570 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:10:59.941914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:10:59.955804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:00.065206 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:00.073502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:00.075062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:00.076231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9b3d88b7-e3e6-4418-98b2-1527807a69f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.151422 Sep 09 21:11:00.076776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 278/553] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:10:59 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:01.102153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:01.102758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:01.109784 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:01.110280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:01.110764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:01.111447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:01.111893 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:01.112338 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:01.446465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:01.455913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:01.457400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:01.458568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-29b64583-ee17-46f9-9f6a-5471b7a28dbc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.360304 Sep 09 21:11:01.459153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 276/554] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:01 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:02.484706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:02.485319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:02.492060 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:02.492567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:02.493003 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:02.493692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:02.494142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:02.494563 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:02.619933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:02.628372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:02.629831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:02.630981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b3619b95-6d4c-4756-8f8f-a7e65b3b63fd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.150613 Sep 09 21:11:02.631536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 279/555] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:02 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:02.829712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-34d7498f-c035-4f16-89f4-231c84f253a7 req-97a818eb-357d-49f6-8387-875f9bc5215b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "name": "network-vif-plugged", "status": "completed", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:11:02.839698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-34d7498f-c035-4f16-89f4-231c84f253a7 req-97a818eb-357d-49f6-8387-875f9bc5215b service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:02.840207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-34d7498f-c035-4f16-89f4-231c84f253a7 req-97a818eb-357d-49f6-8387-875f9bc5215b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:02.840632 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-34d7498f-c035-4f16-89f4-231c84f253a7 req-97a818eb-357d-49f6-8387-875f9bc5215b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:02.853316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-34d7498f-c035-4f16-89f4-231c84f253a7 req-97a818eb-357d-49f6-8387-875f9bc5215b service nova] Creating event network-vif-plugged:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:11:02.858446 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-34d7498f-c035-4f16-89f4-231c84f253a7 req-97a818eb-357d-49f6-8387-875f9bc5215b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Sep 09 21:11:02.859063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 277/556] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:11:03.657571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:03.658280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:03.664929 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:03.665418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:03.665859 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:03.666557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:03.667006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:03.667429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:03.796006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:03.805175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:03.806614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:03.807782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3f63a693-51f9-495d-b9e8-ec2f1cbc422b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.154860 Sep 09 21:11:03.808559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 280/557] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:03 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:04.833596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:04.835735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:04.841055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:04.841597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:04.842032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:04.842716 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:04.843172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:04.843592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:04.971465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:04.980077 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:04.981549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:04.982782 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9875f00b-1656-4274-81a3-b73b12a5e9d9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.153442 Sep 09 21:11:04.983343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 278/558] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:04 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:06.009211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:06.009826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:06.012227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=46 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:06.017649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:06.018137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:06.018575 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:06.019274 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:06.019730 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:06.020182 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:06.152152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:06.165117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:06.165117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:06.165117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e51c8751-3c3c-48d7-82aa-b3ad50733796 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.158441 Sep 09 21:11:06.165540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 281/559] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:06 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:07.190305 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:07.190916 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:07.197398 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:07.197876 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:07.198308 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:07.198994 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:07.199443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:07.199863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:07.324299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:07.333277 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:07.334720 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:07.335925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-53596707-38fa-47aa-a710-9f31d55fc231 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1809 microversion: 2.20 time: 0.150234 Sep 09 21:11:07.336503 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 279/560] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:07 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:08.361995 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:08.362569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:08.368924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:08.369412 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:08.369851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:08.370545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:08.370997 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:08.371423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:08.503007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:08.510542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:08.511944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:08.513134 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-13a27b00-8d94-41c1-8a17-052d7de09e9f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1796 microversion: 2.20 time: 0.155673 Sep 09 21:11:08.513682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 282/561] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:11:08 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:11:24.755273 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:24.755793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:24.758126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=43 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:24.758787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=98 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:24.763374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:24.763860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:24.764369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:24.765706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:24.766148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:24.766573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:24.889684 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lazy-loading 'services' on Instance uuid a509526a-cd3b-48b2-aa86-70185066ab2a {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:11:25.109694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8e0704a2-21ea-40cb-84b0-569c74ce4f52 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a/os-volume_attachments/6635ccde-d965-4d8c-9513-5640fc817f94" status: 202 len: 0 microversion: 2.1 time: 0.358204 Sep 09 21:11:25.110278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 280/562] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:11:24 2022] DELETE /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a/os-volume_attachments/6635ccde-d965-4d8c-9513-5640fc817f94 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:11:27.285338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:27.285840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:27.288430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:27.289225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=26 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:27.293737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:27.294219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:27.294653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:27.295343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:27.295795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:27.296249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:27.320446 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:11:27.538354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d6a6219e-f48a-4078-9824-2f274839a4c3 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 204 len: 0 microversion: 2.1 time: 0.257086 Sep 09 21:11:27.538898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 283/563] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:11:27 2022] DELETE /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:11:27.548493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:27.549790 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:27.556275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:27.556753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:27.557182 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:27.557864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:27.558312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:27.558851 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:27.687641 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:27.695880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f2a34744-cf30-4e1e-a2a8-1ad56b2ee22f tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1514 microversion: 2.1 time: 0.152408 Sep 09 21:11:27.696461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 281/564] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:27 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:28.719547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:28.720279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:28.726655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:28.727137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:28.727571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:28.728287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:28.728761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:28.729174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:28.854111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:28.862237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a891de20-be9d-484b-bd3e-a38163710918 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1514 microversion: 2.1 time: 0.146989 Sep 09 21:11:28.862798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 284/565] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:28 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:29.885704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:29.953156 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:29.956879 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:29.957369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:29.957801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:29.958504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:29.958956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:29.959379 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:30.092837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:30.102049 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-91b8c20f-3146-4887-82c7-03c506addd26 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1514 microversion: 2.1 time: 0.220200 Sep 09 21:11:30.102632 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 282/566] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:29 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:30.713215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-26505d7e-945e-437e-a615-0c9e15a379f2 req-db5f9e66-6684-4999-bca5-561053fae21d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a509526a-cd3b-48b2-aa86-70185066ab2a", "name": "network-vif-deleted", "tag": "bfaac92e-cfcf-497f-977c-6c12b636043f"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:11:30.722862 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-26505d7e-945e-437e-a615-0c9e15a379f2 req-db5f9e66-6684-4999-bca5-561053fae21d service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:30.723492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-26505d7e-945e-437e-a615-0c9e15a379f2 req-db5f9e66-6684-4999-bca5-561053fae21d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:30.723923 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-26505d7e-945e-437e-a615-0c9e15a379f2 req-db5f9e66-6684-4999-bca5-561053fae21d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:30.737384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-26505d7e-945e-437e-a615-0c9e15a379f2 req-db5f9e66-6684-4999-bca5-561053fae21d service nova] Creating event network-vif-deleted:bfaac92e-cfcf-497f-977c-6c12b636043f for instance a509526a-cd3b-48b2-aa86-70185066ab2a on hv-cinder-83124 Sep 09 21:11:30.742370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-26505d7e-945e-437e-a615-0c9e15a379f2 req-db5f9e66-6684-4999-bca5-561053fae21d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147846 Sep 09 21:11:30.742948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 285/567] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:11:31.126676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:31.127308 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:31.133827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:31.134304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:31.134734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:31.135423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:31.135873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:31.136322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:31.167360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:31.167840 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:31.168300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:31.168743 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lazy-loading 'fault' on Instance uuid a509526a-cd3b-48b2-aa86-70185066ab2a {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:11:31.212397 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9129eaa2694ef6b3f006b67ef88c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9d99ec2c254abaa341c4cab6f2c534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:31.221011 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6e18d2b8-d374-4e1a-8fef-4fb45fd7ea0c tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 200 len: 1309 microversion: 2.1 time: 0.098589 Sep 09 21:11:31.225613 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 283/568] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:31 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:32.244097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:32.244832 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] [instance: a509526a-cd3b-48b2-aa86-70185066ab2a] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:32.251442 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:32.251925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:32.252402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:32.253092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:32.253550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:32.253973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:32.267375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] HTTP exception thrown: Instance a509526a-cd3b-48b2-aa86-70185066ab2a could not be found. Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Request method failure captured: Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a HTTP/1.1 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6sdh3eOoCwMMP-Q8Wg14TbcN0X0fR0GbR2lSmUZu9RVOhJWRa2qT2m4uDgb6sf0battU0KaRMTGjWmigItMLJ9AXa_klk26NgEWCrUiRp9QNVFaadV-9ekJj0TTge4P-5EYXnyEzgX40qg5Qan7npps-oMopzLaRR2B0Fq1W6Txqf4 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: ce9d99ec2c254abaa341c4cab6f2c534 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1486706805 Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:11:32.268950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce9d99ec2c254abaa341c4cab6f2c534"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-VolumesSnapshotTestJSON-1486706805 Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: ce9d99ec2c254abaa341c4cab6f2c534 Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1486706805 Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-VolumesSnapshotTestJSON-1486706805-project Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 0d9129eaa2694ef6b3f006b67ef88c52 Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-VolumesSnapshotTestJSON-1486706805-project Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance a509526a-cd3b-48b2-aa86-70185066ab2a could not be found. Sep 09 21:11:32.270279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'a509526a-cd3b-48b2-aa86-70185066ab2a'} Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a509526a-cd3b-48b2-aa86-70185066ab2a could not be found. Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:11:32.271123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a509526a-cd3b-48b2-aa86-70185066ab2a could not be found. Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a509526a-cd3b-48b2-aa86-70185066ab2a could not be found. Sep 09 21:11:32.272670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:11:32.274062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] Returning 404 to user: Instance a509526a-cd3b-48b2-aa86-70185066ab2a could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:11:32.274062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-28edf379-724f-46c5-8a5f-c08be9767444 tempest-VolumesSnapshotTestJSON-1486706805 tempest-VolumesSnapshotTestJSON-1486706805-project] 10.222.0.48 "GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a" status: 404 len: 111 microversion: 2.1 time: 0.030871 Sep 09 21:11:32.274062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 286/569] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:32 2022] GET /compute/v2.1/servers/a509526a-cd3b-48b2-aa86-70185066ab2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:11:42.268116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=10 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:42.268774 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:42.372267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6b08225-58a7-426e-a812-f4fb4e279a72"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:11:42.374688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:42.382983 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:42.383595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:42.384190 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:42.384989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:42.385651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:42.386375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:43.022493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-99171b33-4b00-42e7-96aa-cc587c325a64 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759475 Sep 09 21:11:43.027918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 284/570] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:11:42 2022] POST /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:11:52.684225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:11:52.686429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:52.688724 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:52.689361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:52.694517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:52.694998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:52.695430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:52.696135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:52.696585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:52.697006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:52.719107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lazy-loading 'flavor' on Instance uuid 8adcea70-5a82-48c8-9a07-54f1550e17f5 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:11:53.016791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-de4701f0-464a-4a2f-81ff-74b92f2e6839 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/action" status: 200 len: 32 microversion: 2.1 time: 0.336147 Sep 09 21:11:53.017120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 287/571] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:11:52 2022] POST /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/action => generated 32 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 21:11:53.025646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:53.026417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:11:53.030530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:53.031233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:53.038235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:53.038693 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:53.039139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:53.039839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:53.040320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:53.040744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:53.175766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:53.184274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-43e25c0a-cff6-40fa-893b-11b81ee5c5d6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.160067 Sep 09 21:11:53.185191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 285/572] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:53 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:54.209766 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:54.210382 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:54.216749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:54.217647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:54.217647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:54.218204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:54.218660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:54.219082 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:54.348632 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:54.356773 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1ab65eeb-cbec-4ab9-89d8-4ace4f1136ad tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.152610 Sep 09 21:11:54.362143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 288/573] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:54 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:55.379174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:55.379826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:55.386786 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:55.387270 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:55.387707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:55.388488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:55.388947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:55.392097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:55.521857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:55.530232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-83eff0c5-8f7c-4d85-96a0-a9ceba26460f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.155073 Sep 09 21:11:55.530793 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 286/574] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:55 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:56.554305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:56.554919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:56.561465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:56.561948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:56.562387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:56.563079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:56.563528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:56.563952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:56.695510 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:56.703671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3a3266d3-c7c5-4c15-986e-714ad89ef3d0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.153269 Sep 09 21:11:56.704520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 289/575] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:56 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:11:57.604216 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:57.604776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:57.610489 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:57.611032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:57.611462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:57.612168 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:57.613235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:57.613651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:57.690971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lazy-loading 'services' on Instance uuid 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:11:57.727646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:57.728305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:57.734793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:57.735286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:57.735753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:57.736611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:57.737074 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:57.737528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:57.870384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:57.878537 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2737734e-1f5f-45ef-980c-0966d25f6eaa tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.154968 Sep 09 21:11:57.879104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 290/576] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:57 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:11:57.885744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8c370bb5-55eb-4edb-bad6-50bbe3dea9de tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-volume_attachments/6d0daabc-4354-47c9-93af-a7eba6480b9b" status: 202 len: 0 microversion: 2.1 time: 0.381862 Sep 09 21:11:57.886340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 287/577] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:11:57 2022] DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-volume_attachments/6d0daabc-4354-47c9-93af-a7eba6480b9b => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:11:58.902116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:11:58.902790 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:11:58.909207 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:58.909693 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:58.910130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:58.910824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:11:58.911277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:11:58.911700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:11:59.040950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:11:59.049348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3ab527fd-f673-42c6-87a2-a861959f1d6e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.151107 Sep 09 21:11:59.049958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 291/578] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:11:58 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:00.065013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2e345578-8f86-47eb-880e-a0f820c27bf1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:00.071863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e345578-8f86-47eb-880e-a0f820c27bf1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:00.072511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e345578-8f86-47eb-880e-a0f820c27bf1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:00.072644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:00.073040 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e345578-8f86-47eb-880e-a0f820c27bf1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:00.073345 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:00.079790 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:00.080301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:00.080737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:00.081938 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:00.082387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:00.082805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:00.095799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2e345578-8f86-47eb-880e-a0f820c27bf1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Going to try to stop instance {{(pid=121137) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 21:12:00.217310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:00.226152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d740b0cf-ebf6-44ed-a561-57d20c9a0c93 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.157273 Sep 09 21:12:00.226714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 292/579] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:00 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:00.250030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2e345578-8f86-47eb-880e-a0f820c27bf1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action" status: 202 len: 0 microversion: 2.1 time: 0.189095 Sep 09 21:12:00.250875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 288/580] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:12:00 2022] POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:12:00.259123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:00.259799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:00.265902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:00.266387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:00.266894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:00.267622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:00.268059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:00.269032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:00.394786 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:00.402593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c76213c8-3f4b-4095-89a8-9746b679a9d1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.147266 Sep 09 21:12:00.403153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 293/581] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:00 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:01.255846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:01.256576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:01.263188 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:01.263670 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:01.264134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:01.264825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:01.265268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:01.265684 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:01.395629 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:01.403721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1965915f-2285-4309-97b7-7d59dec49451 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.152687 Sep 09 21:12:01.404423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 289/582] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:01 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:01.426533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:01.427290 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:01.433628 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:01.434109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:01.434567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:01.435249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:01.435694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:01.436156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:01.563701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:01.571989 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3f1a3309-8548-4ec1-87bb-18d14fd43714 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.149902 Sep 09 21:12:01.572586 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 294/583] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:01 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:02.426759 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:02.429141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:02.434036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:02.434651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:02.435215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:02.436194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:02.436722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:02.437223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:02.582888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:02.594671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:02.595301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:02.602914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-18bee88e-f01a-440f-b17d-b475b691a595 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.180011 Sep 09 21:12:02.603493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 290/584] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:02 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:02.620638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:02.621183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:02.621761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:02.622402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:02.622865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:02.623298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:02.754557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:02.762214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fd5fba46-4cd8-4704-ac90-314a2aafba35 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.171587 Sep 09 21:12:02.762779 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 295/585] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:02 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:03.634937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:03.635465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:03.641929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:03.642421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:03.642853 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:03.643541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:03.643999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:03.644447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:03.775029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:03.783148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b29685c1-57c4-4aa3-b3a4-9222d6dd0e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.152243 Sep 09 21:12:03.783705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 291/586] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:03 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:03.785495 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:03.786109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:03.792699 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:03.793180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:03.793614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:03.794297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:03.794744 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:03.795165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:03.920628 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:03.928590 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-cc5f4ea5-c600-46a7-aa4c-655ac5b8d90b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.147537 Sep 09 21:12:03.929323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 296/587] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:03 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:04.806594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:04.807202 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:04.813561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:04.815014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:04.815014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:04.815742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:04.816063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:04.816504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:04.942152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:04.950713 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5ddadcea-e4da-4539-8f8a-d09b09e90891 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.147886 Sep 09 21:12:04.951073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:04.951542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 292/588] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:04 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:04.951695 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:04.959205 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:04.959698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:04.960157 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:04.960857 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:04.961314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:04.961734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:05.090903 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:05.098676 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bde8495a-6ca8-4c2c-9cd7-30f841db5543 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.151582 Sep 09 21:12:05.099244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 297/589] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:04 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:05.974636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:05.975250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:05.981647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:05.982136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:05.982571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:05.983271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:05.983724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:05.984179 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:06.112264 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:06.120457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-53bb226a-181e-47bd-bca8-d917000e4969 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.149605 Sep 09 21:12:06.121020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 293/590] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:05 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:06.121775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:06.122424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:06.128920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:06.129406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:06.129841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:06.130539 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:06.130991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:06.131416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:06.258045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:06.265688 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5a6f749d-32c1-47e2-92fc-f54fe2bd1ec3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.148052 Sep 09 21:12:06.266247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 298/591] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:06 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:07.142539 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:07.143312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:07.149628 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:07.150113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:07.150550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:07.151240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:07.151695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:07.152143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:07.277120 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:07.285803 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ac5cb097-52f0-4081-86c5-683a1eb7efd1 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1734 microversion: 2.1 time: 0.147084 Sep 09 21:12:07.286368 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 294/592] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:07 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:07.289701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:07.290346 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:07.296442 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:07.296921 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:07.297357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:07.298048 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:07.298502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:07.298922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:07.423763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:07.431964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-793a4b0b-e05b-401b-a202-a93ed199a300 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.146143 Sep 09 21:12:07.432550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 299/593] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:07 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:08.309367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:08.309981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:08.316814 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.317298 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.317736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.318425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.318884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.319359 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.449626 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:08.454971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:08.456272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:08.460340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-787f1f8c-f955-48db-a109-56b54f9a8c2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1714 microversion: 2.1 time: 0.154868 Sep 09 21:12:08.460922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 295/594] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:08 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:08.463641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.464154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.464587 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.465284 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.465762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.466181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.585569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:08.586069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:08.592191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.592718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.593159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.593871 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.594325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.594753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.607902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:08.616451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b89f0715-d920-4ef1-9db5-e0f6b04829a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.165456 Sep 09 21:12:08.629342 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 300/595] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:08 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:08.679747 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] HTTP exception thrown: Cannot 'detach_volume' instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 while it is in vm_state rescued Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Request method failure captured: Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments/e6b08225-58a7-426e-a812-f4fb4e279a72 HTTP/1.1 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qVBwptcsDNcMpXRuR0L0x1hK1ma264iEAATbJPo2EBta7NTueIEfkpBnSyyzLWNXoCuwOlZDg3dCZUUupNMPMxinw7dOfz7k_DkchI-ApO_J8wOw2jNs9PWVLO_vRQ19l7QlRucRVD4PUIK2xwJxYyJvVsQ0Fd8dj5HZEiNuDYLR0 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:12:08.682600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25acf91bdf524474b03d44271d08fba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: c764d9778ef74b709cedbccabac37af0 Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:12:08.684236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Cannot 'detach_volume' instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 while it is in vm_state rescued Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'server_id': '8adcea70-5a82-48c8-9a07-54f1550e17f5', 'id': 'e6b08225-58a7-426e-a812-f4fb4e279a72'} Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:12:08.685021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 while it is in vm_state rescued Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 while it is in vm_state rescued Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:12:08.686424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Returning 409 to user: Cannot 'detach_volume' instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 while it is in vm_state rescued {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:12:08.687506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b6927e3f-6cb8-4765-bbd4-3f35ac16f31b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments/e6b08225-58a7-426e-a812-f4fb4e279a72" status: 409 len: 152 microversion: 2.1 time: 0.102623 Sep 09 21:12:08.687506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 296/596] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:12:08 2022] DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments/e6b08225-58a7-426e-a812-f4fb4e279a72 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 21:12:08.693690 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:08.694244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:08.700706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.701186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.701615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.702302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.702748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.703166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.720733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:08.872835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-14bb5e8d-0cab-4a60-81e7-03a065b81c4a tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "POST /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/action" status: 202 len: 0 microversion: 2.1 time: 0.182655 Sep 09 21:12:08.873499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 301/597] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:12:08 2022] POST /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:12:08.881763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:08.882377 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:08.888886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.890882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.890882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:08.890882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:08.891177 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:08.891467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:09.037918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:09.048149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e929dc1a-7f9f-47f5-a7ee-97a27528eb5c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1722 microversion: 2.1 time: 0.169985 Sep 09 21:12:09.049074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 297/598] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:08 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:09.650169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:09.650864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:09.657651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:09.658133 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:09.658560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:09.659778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:09.660261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:09.660687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:09.789246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:09.797160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f4e5c9ca-532f-4c84-b9a2-0b308069f9a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.151648 Sep 09 21:12:09.797714 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 302/599] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:09 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:10.078223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:10.079104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:10.086166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:10.086660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:10.087100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:10.087805 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:10.088297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:10.088727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:10.219007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:10.227187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e150b993-fe9c-4d39-a9b2-34c68d830c28 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1722 microversion: 2.1 time: 0.152848 Sep 09 21:12:10.227745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 298/600] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:10 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:10.820800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:10.821406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:10.828114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:10.828595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:10.829328 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:10.830010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:10.831086 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:10.831559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:10.983352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:10.991034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7e5785bc-94fd-44d7-a044-958f73db5c2f tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.174165 Sep 09 21:12:10.991592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 303/601] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:10 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:11.250490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:11.251100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:11.258140 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:11.258681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:11.259231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:11.260301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:11.260761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:11.261184 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:11.386546 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:11.389991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:11.394953 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-64ed63b9-b26c-451a-a7cd-b9fadb0fef22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1722 microversion: 2.1 time: 0.148481 Sep 09 21:12:11.395508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 299/602] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:11 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:12.014419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:12.015039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:12.021520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:12.021998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:12.022440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:12.023167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:12.023625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:12.024053 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:12.151475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:12.159101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6cd60953-0f77-41cc-8d16-b5a084b9bc3a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.148682 Sep 09 21:12:12.159679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 304/603] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:12 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:12.418619 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:12.419227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:12.426528 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:12.427008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:12.427446 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:12.428165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:12.428618 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:12.429043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:12.562439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:12.571065 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-65cdab8d-f5e4-4f1a-826e-a70e2a7867c6 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1728 microversion: 2.1 time: 0.156755 Sep 09 21:12:12.571689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 300/604] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:12 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:12.593671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:12.594152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:12.600715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:12.601195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:12.601633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:12.602319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:12.602778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:12.603202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:12.679540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5691b3f5-1e6d-484d-894f-85bdbd62bce0 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089680 Sep 09 21:12:12.680154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 305/605] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:12:12 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:13.183218 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:13.183841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:13.190067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:13.190552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:13.190988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:13.191682 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:13.192162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:13.192588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:13.397581 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:13.405211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-248f5959-d501-4be4-bbc4-0cdfaf2577cc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.226296 Sep 09 21:12:13.405772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 301/606] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:13 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:13.766981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-1d1ea7ac-536e-4e01-a679-9ddb3a664019 req-5df3f7b7-8d29-415b-bdca-8578446bfd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adcea70-5a82-48c8-9a07-54f1550e17f5", "tag": "499398d4-9eb5-4074-b98e-a0efaafdc265"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:13.777121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1d1ea7ac-536e-4e01-a679-9ddb3a664019 req-5df3f7b7-8d29-415b-bdca-8578446bfd84 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:13.777597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1d1ea7ac-536e-4e01-a679-9ddb3a664019 req-5df3f7b7-8d29-415b-bdca-8578446bfd84 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:13.778088 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1d1ea7ac-536e-4e01-a679-9ddb3a664019 req-5df3f7b7-8d29-415b-bdca-8578446bfd84 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:13.791726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-1d1ea7ac-536e-4e01-a679-9ddb3a664019 req-5df3f7b7-8d29-415b-bdca-8578446bfd84 service nova] Creating event network-changed:499398d4-9eb5-4074-b98e-a0efaafdc265 for instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 on hv-cinder-83124 Sep 09 21:12:13.796876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-1d1ea7ac-536e-4e01-a679-9ddb3a664019 req-5df3f7b7-8d29-415b-bdca-8578446bfd84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157778 Sep 09 21:12:13.797486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 306/607] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:14.429305 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:14.429983 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:14.436548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:14.437029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:14.437469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:14.438173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:14.438627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:14.439055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:14.574562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:14.583206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-20da1b62-fb5f-45b3-bbf2-517e462dfade tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.157720 Sep 09 21:12:14.583797 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 302/608] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:14 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:15.606705 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:15.607401 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:15.614659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:15.615135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:15.615564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:15.616273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:15.616726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:15.617155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:15.891299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-331660e0-01d8-4ed9-b571-603f54710ddc req-e69610b3-5cb1-461b-bb3c-1d30ce168881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adcea70-5a82-48c8-9a07-54f1550e17f5", "tag": "499398d4-9eb5-4074-b98e-a0efaafdc265"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:15.900975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-331660e0-01d8-4ed9-b571-603f54710ddc req-e69610b3-5cb1-461b-bb3c-1d30ce168881 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:15.901451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-331660e0-01d8-4ed9-b571-603f54710ddc req-e69610b3-5cb1-461b-bb3c-1d30ce168881 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:15.901881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-331660e0-01d8-4ed9-b571-603f54710ddc req-e69610b3-5cb1-461b-bb3c-1d30ce168881 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:15.912752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-331660e0-01d8-4ed9-b571-603f54710ddc req-e69610b3-5cb1-461b-bb3c-1d30ce168881 service nova] Creating event network-changed:499398d4-9eb5-4074-b98e-a0efaafdc265 for instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 on hv-cinder-83124 Sep 09 21:12:15.917741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-331660e0-01d8-4ed9-b571-603f54710ddc req-e69610b3-5cb1-461b-bb3c-1d30ce168881 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030135 Sep 09 21:12:15.918334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 303/609] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:15.965078 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:15.972867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-50c5998d-e8f0-49e8-8d1e-e8d2e97863fd tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.370433 Sep 09 21:12:15.973431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 307/610] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:15 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:16.996282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:16.996987 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:17.003569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:17.004051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:17.004510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:17.005200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:17.005659 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:17.006086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:17.133673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:17.141975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ad5758ae-8012-4295-abd1-1c5f9bdd00f1 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1678 microversion: 2.1 time: 0.150388 Sep 09 21:12:17.142543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 304/611] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:16 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:18.168089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:18.169042 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:18.178393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:18.179125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:18.179790 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:18.180886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:18.181593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:18.182255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:18.320494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:18.328017 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fd279d66-eb14-49bd-9f94-d85b01844bca tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1655 microversion: 2.1 time: 0.166292 Sep 09 21:12:18.328597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 308/612] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:18 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:18.350848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-80c22dc7-5edc-4a5a-97c7-e34b2b5a1b06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:18.357232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-80c22dc7-5edc-4a5a-97c7-e34b2b5a1b06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:18.357705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-80c22dc7-5edc-4a5a-97c7-e34b2b5a1b06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:18.358135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-80c22dc7-5edc-4a5a-97c7-e34b2b5a1b06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:18.379668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-80c22dc7-5edc-4a5a-97c7-e34b2b5a1b06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Going to try to start instance {{(pid=121137) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 21:12:18.581765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-80c22dc7-5edc-4a5a-97c7-e34b2b5a1b06 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action" status: 202 len: 0 microversion: 2.1 time: 0.234576 Sep 09 21:12:18.582364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 305/613] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:12:18 2022] POST /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:12:18.593589 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:18.594475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:18.600414 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:18.600910 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:18.601349 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:18.602057 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:18.602500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:18.603376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:18.734596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:18.743459 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d61cde45-5cd7-4f10-a71b-9bdc56fd94d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1664 microversion: 2.1 time: 0.153684 Sep 09 21:12:18.744348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 309/614] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:18 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:19.767764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:19.768506 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:19.774570 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:19.775050 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:19.775487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:19.776197 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:19.776653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:19.777076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:19.908752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:19.916442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-dea5d3cd-f74a-470c-88e1-494c708794c4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1664 microversion: 2.1 time: 0.153374 Sep 09 21:12:19.917000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 306/615] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:19 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:20.940696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:20.941317 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:20.947738 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:20.948264 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:20.948706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:20.949408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:20.949867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:20.950330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:21.076132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:21.083994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-df66356a-9fb2-4283-9c3f-0decf95126a3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1668 microversion: 2.1 time: 0.147810 Sep 09 21:12:21.084626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 310/616] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:20 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:28.298005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:28.298548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:28.301266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=45 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:28.305948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:28.316895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:28.316895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:28.316895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:28.316895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:28.317295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:28.337592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f543b580-bbf0-41f8-8156-8ba7de922ed3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments/7c78d9e8-55d6-491c-9a86-8bdab794f31b" status: 200 len: 194 microversion: 2.20 time: 0.043912 Sep 09 21:12:28.345574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 307/617] 10.222.0.48 () {60 vars in 1454 bytes} [Fri Sep 9 21:12:28 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments/7c78d9e8-55d6-491c-9a86-8bdab794f31b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:12:28.407355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:28.408492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:28.411080 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=49 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:28.415653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:28.416283 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:28.416718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:28.417397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:28.417852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:28.418267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:28.498945 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lazy-loading 'services' on Instance uuid d1900205-eef2-494e-b59c-a7ea601f4835 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:12:28.708663 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e9f6fbec-324d-4029-ad85-16d0ea782cae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments/7c78d9e8-55d6-491c-9a86-8bdab794f31b" status: 202 len: 0 microversion: 2.20 time: 0.305024 Sep 09 21:12:28.709385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 311/618] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Sep 9 21:12:28 2022] DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments/7c78d9e8-55d6-491c-9a86-8bdab794f31b => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:12:28.717994 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:28.720248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:28.727036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:28.728054 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:28.728054 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:28.728654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:28.729108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:28.729537 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:28.759448 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-91f1ba6a-4d20-4e3a-a656-9c0a9ac53a79 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045746 Sep 09 21:12:28.759997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 308/619] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Sep 9 21:12:28 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:12:29.772168 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:29.774541 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:29.785143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:29.785143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:29.785143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:29.785143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:29.785555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:29.785555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:29.812989 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-cc377d79-6c99-42c0-9516-1d574ee1e06f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045099 Sep 09 21:12:29.816973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 312/620] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Sep 9 21:12:29 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:12:30.825283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:30.827325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:30.834104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:30.834577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:30.835008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:30.835698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:30.836169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:30.836592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:30.867442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-461e8ced-8ae0-43c6-87d7-05fd07374264 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046222 Sep 09 21:12:30.867995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 309/621] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Sep 9 21:12:30 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:30.931749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:30.932282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:30.938063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:30.938597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:30.939039 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:30.939725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:30.940213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:30.940637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:30.965696 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:12:31.018190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:31.018717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:31.024561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:31.025038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:31.025469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:31.026154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:31.026601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:31.027020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:31.048755 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lazy-loading 'flavor' on Instance uuid 1b6c6972-1eb9-4a42-ab0f-aa924936f83d {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:12:31.268883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-eb3eb165-4817-42d6-b142-ddb694d9319e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 204 len: 0 microversion: 2.20 time: 0.340678 Sep 09 21:12:31.269486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 310/622] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Sep 9 21:12:30 2022] DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 21:12:31.278259 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:31.279419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:31.285393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:31.285895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:31.286340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:31.287030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:31.287479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:31.287897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:31.304488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5f416c0d-0bc9-4cde-8a1e-e1efa74b313d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "POST /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d/action" status: 202 len: 0 microversion: 2.1 time: 0.396157 Sep 09 21:12:31.305089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 313/623] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:12:30 2022] POST /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:12:31.313717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:31.314767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:31.321194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:31.321774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:31.322209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:31.322934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:31.323457 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:31.323874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:31.471961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:31.480137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:31.481643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:31.482917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c4017f9e-a8ae-4b2c-aa1f-5ed606186eb6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.208864 Sep 09 21:12:31.483482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 311/624] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:31 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:31.495390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:31.503134 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-617ed774-c72e-4cbe-b794-ebb32e798c51 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.193498 Sep 09 21:12:31.503696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 314/625] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:31 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:32.508206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:32.508841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:32.515331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:32.515802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:32.516267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:32.516952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:32.517400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:32.517894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:32.526178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:32.526789 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:32.533571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:32.534042 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:32.534473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:32.535164 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:32.535614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:32.536088 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:32.554218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:32.712060 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:32.719939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:32.721930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:32.723082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3020da6c-317b-4b6e-ade4-6785c1997754 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.218783 Sep 09 21:12:32.723633 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 312/626] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:32 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:32.725265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:32.733042 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0b19c2b4-57ee-41a1-8e9b-922227a8dfd7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.210627 Sep 09 21:12:32.733596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 315/627] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:32 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:33.748902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:33.749534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:33.756122 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:33.756609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:33.757042 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:33.757195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:33.757735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:33.758183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:33.758326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:33.758599 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:33.765506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:33.766002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:33.766439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:33.767482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:33.768480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:33.768909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:33.965481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:33.969558 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:33.974846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:33.976370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:33.977542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6157a942-fab0-4238-9d4a-741c9e45ab31 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1724 microversion: 2.20 time: 0.232593 Sep 09 21:12:33.978161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-92213ff2-8304-4280-92b7-9a5065c14601 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.225285 Sep 09 21:12:33.992372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 316/628] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:33 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:33.992931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 313/629] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:33 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:34.521229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-04298a36-2c40-428d-9ce2-a5b92ca085c7 req-918e7c25-47ab-4fe2-88b0-a5e6fa442381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1900205-eef2-494e-b59c-a7ea601f4835", "name": "network-vif-deleted", "tag": "ccbb35e5-813f-4f89-b318-6bdd6b139a1d"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:34.530758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-04298a36-2c40-428d-9ce2-a5b92ca085c7 req-918e7c25-47ab-4fe2-88b0-a5e6fa442381 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:34.531246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-04298a36-2c40-428d-9ce2-a5b92ca085c7 req-918e7c25-47ab-4fe2-88b0-a5e6fa442381 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:34.531679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-04298a36-2c40-428d-9ce2-a5b92ca085c7 req-918e7c25-47ab-4fe2-88b0-a5e6fa442381 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:34.543338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-04298a36-2c40-428d-9ce2-a5b92ca085c7 req-918e7c25-47ab-4fe2-88b0-a5e6fa442381 service nova] Creating event network-vif-deleted:ccbb35e5-813f-4f89-b318-6bdd6b139a1d for instance d1900205-eef2-494e-b59c-a7ea601f4835 on hv-cinder-83124 Sep 09 21:12:34.548873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-04298a36-2c40-428d-9ce2-a5b92ca085c7 req-918e7c25-47ab-4fe2-88b0-a5e6fa442381 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032273 Sep 09 21:12:34.549614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 317/630] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:35.003841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:35.004509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:35.005851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:35.007361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:35.017780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:35.018711 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:35.019590 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:35.019929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:35.020470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:35.020907 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:35.021791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:35.021912 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:35.022337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:35.022768 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:35.023302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:35.023955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:35.048482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:35.062386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:35.062990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:35.063611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:35.064261 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lazy-loading 'fault' on Instance uuid d1900205-eef2-494e-b59c-a7ea601f4835 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:12:35.135540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:35.153187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:35.155006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:35.156501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-49b684f3-3282-49bb-b3a8-59e2cd08999a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 200 len: 1371 microversion: 2.20 time: 0.156966 Sep 09 21:12:35.168741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 318/631] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:34 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:35.226143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:35.235153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b613c3f9-d7dc-4ab8-8de6-0884f7a2dffa tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.235760 Sep 09 21:12:35.236471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 314/632] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:34 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:36.190567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:36.191170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:36.197637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:36.198116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:36.198546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:36.199276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:36.199679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:36.200117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:36.213756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] HTTP exception thrown: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Request method failure captured: Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 HTTP/1.1 Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qd63DX4VBTrtw9I4V_Zwz7NvlcN5aBoQrLtpRkPfhuxagC84Im8w3b2OsWEh8xeG4il6laWD9uYct36GZ3MDTdOs8YJs1MD0AukXVgO8_fDKGrj7OfRqFicjpLddumfmnRD5WwNmqV724X3eeo2MZp3tDeGOP79L8KT-JZPhdea1k Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:12:36.215423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 710e49db188845bbae5a183c6657e07f Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:12:36.217347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'd1900205-eef2-494e-b59c-a7ea601f4835'} Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:12:36.218302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:12:36.219793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:12:36.221586 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Returning 404 to user: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:12:36.222461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b8ad6f29-d4d1-4495-981d-b6341c5e1864 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 404 len: 111 microversion: 2.20 time: 0.036608 Sep 09 21:12:36.223044 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 319/633] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:36 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:12:36.232324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2887cd5d-0759-4a8a-8537-dad2d3634729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '.version_select at 0x7fa1d0b49e50>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:36.258876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:36.259478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:36.265278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:36.265757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:36.266188 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:36.266879 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:36.267330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:36.268318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:36.315958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2887cd5d-0759-4a8a-8537-dad2d3634729 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720501414" status: 204 len: 0 microversion: 2.20 time: 0.087518 Sep 09 21:12:36.316567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 315/634] 10.222.0.48 () {60 vars in 1259 bytes} [Fri Sep 9 21:12:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720501414 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 09 21:12:36.404387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:36.412191 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bb9ff503-94c2-4207-baad-22c82ab9ecff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.157015 Sep 09 21:12:36.412757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 320/635] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:36 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:37.086412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-686420dd-14e3-473a-9274-5cae4455c7f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'create', calling method: .version_select at 0x7fa1d0934b80>, body: {"keypair": {"name": "tempest-keypair-445231110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmyljpwm+WSiCTTtlw8aBKhFWrFFwbtkZcdZjucOA+nTk+/p8AK/WoCQGtUD5bZvDeQ4EbGfQyRzoXBYGfNGXQlqTJbtvcasGSnqaWPLV8RXOv7oAs61QWa1UULvr7PMA=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:37.103521 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-686420dd-14e3-473a-9274-5cae4455c7f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:12:37.107314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-686420dd-14e3-473a-9274-5cae4455c7f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for user 710e49db188845bbae5a183c6657e07f and project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:12:37.172707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-686420dd-14e3-473a-9274-5cae4455c7f4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.090196 Sep 09 21:12:37.173310 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 316/636] 10.222.0.48 () {62 vars in 1200 bytes} [Fri Sep 9 21:12:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 21:12:37.437495 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:37.438246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:37.444921 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:37.445337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:37.445811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:37.446511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:37.447144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:37.447571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:37.603335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:37.611135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d912812f-8341-4ee8-a5a2-6cd239e33cd0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.178889 Sep 09 21:12:37.611694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 321/637] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:37 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:38.636639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:38.637369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:38.644429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:38.644922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:38.645363 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:38.646070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:38.646719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:38.647142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:38.780542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:38.788452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9ec393be-3c9f-429f-8440-fa78adb27612 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.157954 Sep 09 21:12:38.789001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 317/638] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:38 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:39.252661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-422847838", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5b279e2-8202-4675-bfc5-cba52dbbdbb7"}], "security_groups": [{"name": "tempest-securitygroup--690926249"}], "key_name": "tempest-keypair-445231110", "user_data": "}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:39.353219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] validate_networks() for [('e5b279e2-8202-4675-bfc5-cba52dbbdbb7', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:12:39.799841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:12:39.800312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:12:39.800795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:12:39.801207 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:12:39.801620 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:12:39.810377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:39.810791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:39.811223 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:39.811322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:39.811437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:39.812010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:39.812504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:39.812930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:39.817760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:39.818235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:39.818665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:39.819343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:39.819955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:39.820405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:39.830532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:12:39.834576 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Getting quotas for user 710e49db188845bbae5a183c6657e07f and project 620d0a2c4566408aa134f2a8ac7d91ee. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:12:39.846135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:12:39.848478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:12:39.949758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:39.958053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-65fc5e4b-8a9d-4c02-a2ad-e18c7c8e51f2 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.151048 Sep 09 21:12:39.958547 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 318/639] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:39 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:39.979061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-647b9db7-687a-4130-8328-40296298d08d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.731400 Sep 09 21:12:39.980141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 322/640] 10.222.0.48 () {62 vars in 1188 bytes} [Fri Sep 9 21:12:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 21:12:39.991533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4cfd77a3-a95a-4747-8842-59d91eaee494 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:39.992236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4cfd77a3-a95a-4747-8842-59d91eaee494 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:40.044863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4cfd77a3-a95a-4747-8842-59d91eaee494 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:40.053282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4cfd77a3-a95a-4747-8842-59d91eaee494 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:40.054901 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4cfd77a3-a95a-4747-8842-59d91eaee494 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:40.055989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4cfd77a3-a95a-4747-8842-59d91eaee494 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1280 microversion: 2.20 time: 0.068296 Sep 09 21:12:40.056569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 319/641] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:39 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:40.982092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:40.982742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:40.989864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:40.990416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:40.990850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:40.991625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:40.992087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:40.992524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:41.082247 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:41.082851 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:41.090277 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:41.090765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:41.091196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:41.091892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:41.092369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:41.092787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:41.126414 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:41.134643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a46b143b-d41f-485f-9b5f-e0843bd9e948 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.157004 Sep 09 21:12:41.137922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 323/642] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:40 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:41.159517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:41.168244 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:41.170086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:41.171208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2aaaef47-fc41-4f26-a474-20ec9b482b5e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1284 microversion: 2.20 time: 0.093635 Sep 09 21:12:41.171749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 320/643] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:41 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:42.158662 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:42.159258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:42.165818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:42.166318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:42.166732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:42.167426 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:42.167880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:42.168341 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:42.197892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:42.199836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:42.209685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:42.210587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:42.211031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:42.211749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:42.212416 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:42.212850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:42.298192 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:42.315829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:42.317407 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:42.318481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1654be8b-f01d-4daf-acbd-aabc6ec0bcfe tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1340 microversion: 2.20 time: 0.125575 Sep 09 21:12:42.319040 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 321/644] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:42 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1340 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:42.359906 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:42.368416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-eac9f977-f59f-4ea4-a94c-7682c7e743ae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.213610 Sep 09 21:12:42.369519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 324/645] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:42 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:43.344005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:43.344924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:43.352268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:43.352744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:43.353174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:43.353862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:43.354306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:43.354720 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:43.391046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:43.391699 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:43.398209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:43.398932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:43.399367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:43.400106 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:43.400920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:43.401349 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:43.541681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:43.550764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:43.552503 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:43.553711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8d926400-ee21-4e54-9dd2-dba6a3528c0f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.213667 Sep 09 21:12:43.565245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 322/646] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:43 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:43.576521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:43.584722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b7404882-b2ef-4931-afc8-45642457eaae tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.197951 Sep 09 21:12:43.585305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 325/647] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:43 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:44.273071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-aee5900d-39c8-420a-82e8-335c44b353ea req-dd0aa57a-3a2c-49c2-a2ea-d9d1c18f666a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:44.282792 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-aee5900d-39c8-420a-82e8-335c44b353ea req-dd0aa57a-3a2c-49c2-a2ea-d9d1c18f666a service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:44.283309 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-aee5900d-39c8-420a-82e8-335c44b353ea req-dd0aa57a-3a2c-49c2-a2ea-d9d1c18f666a service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:44.283739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-aee5900d-39c8-420a-82e8-335c44b353ea req-dd0aa57a-3a2c-49c2-a2ea-d9d1c18f666a service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:44.294576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-aee5900d-39c8-420a-82e8-335c44b353ea req-dd0aa57a-3a2c-49c2-a2ea-d9d1c18f666a service nova] Creating event network-changed:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:12:44.299890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-aee5900d-39c8-420a-82e8-335c44b353ea req-dd0aa57a-3a2c-49c2-a2ea-d9d1c18f666a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030622 Sep 09 21:12:44.300516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 323/648] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:44.579171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:44.580367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:44.586787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:44.587268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:44.587726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:44.588443 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:44.588896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:44.589317 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:44.608600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:44.609937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:44.616860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:44.617266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:44.617705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:44.618548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:44.618999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:44.619595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:44.801218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:44.805034 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:44.810031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:44.811577 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:44.812802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5af2ebb1-0723-4e0d-9865-26cb11283bdc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.237836 Sep 09 21:12:44.812918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bcce9c09-bff1-42ca-9028-08a4acaafc39 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.209149 Sep 09 21:12:44.813454 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 324/650] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:44 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:44.813598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 326/650] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:44 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:45.836600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:45.837371 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:45.837856 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:45.838471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:45.843891 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:45.844395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:45.844800 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:45.844911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:45.845888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:45.846147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:45.846323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:45.846595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:45.847005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:45.847104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:45.847457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:45.847874 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:46.041323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:46.045917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:46.050052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:46.051492 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:46.052632 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b239c3a5-5cc0-4537-88cf-a2b2b6da073b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.218635 Sep 09 21:12:46.053191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 325/651] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:45 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:46.054040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-cff7d304-5d20-4a18-a097-10f69ecb6a7c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.221265 Sep 09 21:12:46.054595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 327/652] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:45 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:47.077132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:47.077749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:47.078343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:47.079247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:47.085244 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:47.085728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:47.086160 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:47.086276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:47.086699 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:47.086852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:47.087142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:47.087314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:47.087738 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:47.087835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:47.088295 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:47.088702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:47.287462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:47.290536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:47.299783 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:47.301559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:47.301784 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-121622fd-b47b-4f11-97c7-7cdda1496d50 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.228444 Sep 09 21:12:47.302816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 326/653] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:47 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:12:47.303363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c55fae12-a328-41e4-9f61-69bdc3ab3d83 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.228740 Sep 09 21:12:47.304325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 328/654] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:47 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:48.325455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:48.326124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:48.327766 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:48.328510 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:48.332786 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:48.333269 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:48.333701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:48.334399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:48.334850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:48.335273 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:48.335381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:48.335853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:48.336310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:48.337068 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:48.337521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:48.338120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:48.536978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:48.540837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:48.546473 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-44f8db44-5e09-492e-b097-a1f990eacb05 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.225470 Sep 09 21:12:48.547039 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 327/655] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:48 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:48.549794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:48.551428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:48.552630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f8e18d3c-b207-4d7d-921d-f8ade0ad7fd4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.228937 Sep 09 21:12:48.553301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 329/656] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:48 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:49.516641 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-4d8e600f-8654-4cc2-9727-8d00ba78ecea req-50180cf5-b2e1-40f8-a664-774b0c617a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "name": "network-vif-plugged", "status": "completed", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:49.525830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4d8e600f-8654-4cc2-9727-8d00ba78ecea req-50180cf5-b2e1-40f8-a664-774b0c617a12 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:49.526307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4d8e600f-8654-4cc2-9727-8d00ba78ecea req-50180cf5-b2e1-40f8-a664-774b0c617a12 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:49.526732 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4d8e600f-8654-4cc2-9727-8d00ba78ecea req-50180cf5-b2e1-40f8-a664-774b0c617a12 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:49.537369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-4d8e600f-8654-4cc2-9727-8d00ba78ecea req-50180cf5-b2e1-40f8-a664-774b0c617a12 service nova] Creating event network-vif-plugged:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:12:49.542249 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-4d8e600f-8654-4cc2-9727-8d00ba78ecea req-50180cf5-b2e1-40f8-a664-774b0c617a12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088990 Sep 09 21:12:49.543072 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 328/657] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:49.569422 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:49.570145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:49.577715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:49.578429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:49.580974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:49.581082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:49.581082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:49.581258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:49.581258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:49.581258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:49.586524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:49.587139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:49.587581 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:49.588319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:49.588770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:49.589189 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:49.782432 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:49.808149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:49.808369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8db68393-11eb-4393-9e30-e91323d6e50a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.225212 Sep 09 21:12:49.808369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 330/658] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:49 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:49.808564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:49.808564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:49.808564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e2a1cdcf-576d-456d-88d1-24c7052ad2c5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.225548 Sep 09 21:12:49.808844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 329/659] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:49 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:50.814532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:50.815139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:50.817079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:50.817737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:50.822896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:50.823375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:50.823806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:50.824538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:50.824988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:50.825410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:50.839496 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:50.840121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:50.842058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:50.847701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:50.848216 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:50.848659 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:50.849348 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:50.849807 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:50.850231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:51.023369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:51.030331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:51.031140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d0c42cb1-e9f0-46f6-8ff2-7b36ae6abb67 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.220510 Sep 09 21:12:51.031854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 331/660] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:50 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:51.038662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:51.040245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:51.041437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4da54a38-2260-4939-b33b-32349c0239bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.205857 Sep 09 21:12:51.042058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 330/661] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:50 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:52.055055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:52.055819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:52.063974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.064574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.065079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.065880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.066003 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:52.066432 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.066729 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.071552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:52.074920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.075404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.075829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.076931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.077381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.077802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.279304 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:52.282802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:52.288122 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e479511d-9b79-44b0-aaae-6f034545ee3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1570 microversion: 2.1 time: 0.236911 Sep 09 21:12:52.289262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 332/662] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:52 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:52.291341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:52.292900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:52.294039 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c0a407b5-cf6c-4a81-b3e5-5d63c1a2283f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1405 microversion: 2.20 time: 0.232270 Sep 09 21:12:52.294574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 331/663] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:52 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:12:52.313066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:52.313664 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:52.320025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.321458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.321458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.321673 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.322080 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.322505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.363884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121136) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 21:12:52.472979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:52.613600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bd003110-b1e1-4fbd-8114-27c7719f1902 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "POST /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d/action" status: 202 len: 0 microversion: 2.1 time: 0.307079 Sep 09 21:12:52.614495 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 333/664] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:12:52 2022] POST /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:12:52.622929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:52.623783 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:52.630587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.631069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.631495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.632214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:52.632664 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:52.633079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:52.801827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:52.814541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f7e8df4d-9cc4-41a5-aa2f-c877c36c3d3a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1578 microversion: 2.1 time: 0.195668 Sep 09 21:12:52.815499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 332/665] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:52 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:53.319898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:53.322302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:53.322439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-cd81dc47-c76a-40a7-b95c-df2ec56a9c13 req-e7ea3521-20b7-4532-86ca-7bb9c3aefed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "name": "network-vif-unplugged", "status": "completed", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:53.328540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.329234 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.329867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.331140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.331593 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.332017 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.332851 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-cd81dc47-c76a-40a7-b95c-df2ec56a9c13 req-e7ea3521-20b7-4532-86ca-7bb9c3aefed4 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.333445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-cd81dc47-c76a-40a7-b95c-df2ec56a9c13 req-e7ea3521-20b7-4532-86ca-7bb9c3aefed4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.333949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-cd81dc47-c76a-40a7-b95c-df2ec56a9c13 req-e7ea3521-20b7-4532-86ca-7bb9c3aefed4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.345041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.compute.server_external_events [req-cd81dc47-c76a-40a7-b95c-df2ec56a9c13 req-e7ea3521-20b7-4532-86ca-7bb9c3aefed4 service nova] Unable to find a host for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d. Dropping event network-vif-unplugged {{(pid=121137) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 21:12:53.345918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-cd81dc47-c76a-40a7-b95c-df2ec56a9c13 req-e7ea3521-20b7-4532-86ca-7bb9c3aefed4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029166 Sep 09 21:12:53.347144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 333/666] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 09 21:12:53.463641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:53.473304 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:53.476353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:53.477934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-578cf2f8-7cb7-4114-8218-c912ebb26836 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1597 microversion: 2.20 time: 0.162977 Sep 09 21:12:53.479182 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 334/667] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:12:53 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1597 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:12:53.505742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:53.506697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:53.514253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.519030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.519030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.519030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.519030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.519463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.603146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9ebdd20c-e56d-4167-b86e-129a291db3d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103624 Sep 09 21:12:53.603726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 334/668] 10.222.0.48 () {60 vars in 1316 bytes} [Fri Sep 9 21:12:53 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:12:53.846001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:53.847212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:53.853369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.853857 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.854291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.854988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:53.855443 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:53.855867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:53.990040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:53.997814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ace52b39-39fb-4a4c-83ae-45b45e95a111 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1520 microversion: 2.1 time: 0.155652 Sep 09 21:12:53.998594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 335/669] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:53 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:54.587109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-a415ac27-bec9-430a-b008-1ccf4a9681ab req-f0ff8490-6228-4c34-928f-209b972db693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:12:54.596989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a415ac27-bec9-430a-b008-1ccf4a9681ab req-f0ff8490-6228-4c34-928f-209b972db693 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:54.597470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a415ac27-bec9-430a-b008-1ccf4a9681ab req-f0ff8490-6228-4c34-928f-209b972db693 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:54.597898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a415ac27-bec9-430a-b008-1ccf4a9681ab req-f0ff8490-6228-4c34-928f-209b972db693 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:54.608986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-a415ac27-bec9-430a-b008-1ccf4a9681ab req-f0ff8490-6228-4c34-928f-209b972db693 service nova] Creating event network-changed:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:12:54.614887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-a415ac27-bec9-430a-b008-1ccf4a9681ab req-f0ff8490-6228-4c34-928f-209b972db693 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032796 Sep 09 21:12:54.617094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 335/670] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:12:55.032937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:55.034803 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:55.041633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:55.042197 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:55.043332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:55.043698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:55.044431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:55.045078 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:55.183964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:55.192485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a6c6c0e1-fb1d-424e-af81-6b25b47c5979 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1520 microversion: 2.1 time: 0.163499 Sep 09 21:12:55.193539 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 336/671] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:55 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:56.217457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:56.218097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:56.224510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:56.225005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:56.225440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:56.226154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:56.226606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:56.227065 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:56.376076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:56.383758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-251dd43e-ca17-4ce8-9180-91d675932197 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.171149 Sep 09 21:12:56.384361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 336/672] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:56 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:57.406861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:57.407475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:57.413952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:57.414421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:57.414847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:57.415522 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:57.415968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:57.416406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:57.542815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:57.551045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c7d597e5-d9d9-4979-9653-450b9d8dca3f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.147997 Sep 09 21:12:57.551610 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 337/673] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:57 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:58.573924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:58.574536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:58.581333 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:58.581809 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:58.582240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:58.582923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:58.583368 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:58.583785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:58.587924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:58.712521 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:58.720470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-417c22d5-c5a2-4190-be4f-92e5f6eb4ac3 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.150327 Sep 09 21:12:58.721042 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 337/674] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:58 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:12:59.742924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:12:59.743526 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:12:59.746098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:12:59.750925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:59.751402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:59.751834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:59.753141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:12:59.753585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:12:59.754001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:12:59.884166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:12:59.891820 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-12118a7b-e142-428e-ad62-6e2c9804ab62 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.152828 Sep 09 21:12:59.892485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 338/675] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:12:59 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:00.915309 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:00.915923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:00.918346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:00.923022 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:00.923523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:00.924022 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:00.924735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:00.925183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:00.925600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:01.055809 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:01.063439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0f47510b-9751-4628-b9c6-ee8d40f9120e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.152016 Sep 09 21:13:01.063999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 338/676] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:00 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:02.087030 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:02.087641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:02.094179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:02.094658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:02.095089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:02.097659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:02.097659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:02.097659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:02.226309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:02.233967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-53a75349-ea26-4488-82b8-e75e64903f8e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.150761 Sep 09 21:13:02.234525 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 339/677] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:02 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:03.257322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:03.257932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:03.264252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:03.264729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:03.265160 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:03.265849 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:03.266300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:03.266719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:03.393083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:03.400752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-84865c79-4f3b-4617-9293-e8e1868b20fd tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.147366 Sep 09 21:13:03.401347 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 339/678] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:03 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:04.424272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:04.425452 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:04.432055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:04.432596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:04.433029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:04.433894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:04.434350 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:04.434781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:04.567953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:04.575740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a8a7d38a-b8ad-4a27-b2e5-e5d1d9c9c82a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.155191 Sep 09 21:13:04.576325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 340/679] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:04 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:05.599003 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:05.599641 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:05.605958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:05.606433 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:05.606861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:05.607542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:05.607986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:05.608423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:05.733818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:05.741430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2a0500a0-fe81-42fb-b83b-c9f8866c4988 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.146416 Sep 09 21:13:05.741977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 340/680] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:05 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:06.764130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:06.764674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:06.771665 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:06.772174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:06.772614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:06.773307 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:06.773760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:06.774180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:06.900673 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:06.908326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0398d2c3-4f14-447a-ae8a-3076b5ef8de6 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.148223 Sep 09 21:13:06.908896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 341/681] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:06 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:07.518866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-c5284930-982d-4ef8-b29a-0b455fcfcfb7 req-0795e4ab-0bb9-499e-8b42-2858b995a929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "name": "network-vif-plugged", "status": "completed", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:07.528480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-c5284930-982d-4ef8-b29a-0b455fcfcfb7 req-0795e4ab-0bb9-499e-8b42-2858b995a929 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:07.528953 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-c5284930-982d-4ef8-b29a-0b455fcfcfb7 req-0795e4ab-0bb9-499e-8b42-2858b995a929 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:07.529375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-c5284930-982d-4ef8-b29a-0b455fcfcfb7 req-0795e4ab-0bb9-499e-8b42-2858b995a929 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:07.539924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-c5284930-982d-4ef8-b29a-0b455fcfcfb7 req-0795e4ab-0bb9-499e-8b42-2858b995a929 service nova] Creating event network-vif-plugged:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:13:07.544993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-c5284930-982d-4ef8-b29a-0b455fcfcfb7 req-0795e4ab-0bb9-499e-8b42-2858b995a929 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029763 Sep 09 21:13:07.545563 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 341/682] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:07.932191 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:07.932806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:07.939292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:07.939834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:07.940312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:07.942072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:07.942529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:07.942953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:08.073160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:08.081814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ddbb942e-a037-4354-b944-e41f70ad1594 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.152992 Sep 09 21:13:08.082387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 342/683] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:07 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:09.105715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:09.106415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:09.112609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:09.113121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:09.113561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:09.114256 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:09.114705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:09.115126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:09.241451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:09.249135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fbc01488-a110-4f43-b544-69db512d5a0f tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1576 microversion: 2.1 time: 0.148150 Sep 09 21:13:09.249694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 342/684] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:09 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:10.273233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:10.273781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:10.280047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:10.280552 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:10.280981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:10.281660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:10.282102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:10.282519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:10.613727 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:10.621298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c5065382-53b2-4dc1-ac74-7221ea2af2c0 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1563 microversion: 2.1 time: 0.352588 Sep 09 21:13:10.621852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 343/685] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:10 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1563 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:16.464394 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:16.464930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:16.471301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:16.471778 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:16.472279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:16.472961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:16.473406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:16.473822 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:16.553231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lazy-loading 'services' on Instance uuid 8adcea70-5a82-48c8-9a07-54f1550e17f5 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:13:16.741411 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bb305bd2-e2ca-4053-b664-c1d950251bb7 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments/e6b08225-58a7-426e-a812-f4fb4e279a72" status: 202 len: 0 microversion: 2.1 time: 0.280797 Sep 09 21:13:16.742092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 343/686] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:13:16 2022] DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments/e6b08225-58a7-426e-a812-f4fb4e279a72 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:13:16.750326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:16.752707 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:16.759338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:16.759823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:16.760291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:16.760980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:16.761429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:16.761846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:16.796589 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b727b8df-8f69-494f-b9ff-94788ba04760 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050025 Sep 09 21:13:16.797147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 344/687] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:13:16 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:17.220207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:17.220823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:17.227436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:17.227916 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:17.228378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:17.229067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:17.229519 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:17.229939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:17.255777 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:13:17.525080 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c53016ef-c90c-4425-a01b-25aa8147758f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 204 len: 0 microversion: 2.1 time: 0.403404 Sep 09 21:13:17.525868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 344/688] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:13:17 2022] DELETE /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:13:17.533841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:17.534521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:17.540574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:17.541118 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:17.541632 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:17.542368 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:17.542871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:17.543298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:17.672639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:17.680418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ca21ce52-4852-43e5-8f41-23d3219fc5bb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1575 microversion: 2.1 time: 0.150608 Sep 09 21:13:17.680988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 345/689] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:17 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:17.810041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:17.812332 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:17.818754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:17.819226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:17.819650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:17.820354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:17.820801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:17.821302 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:17.850643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e03939d7-fd7b-4a46-a6bc-08aaacb20e05 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Sep 09 21:13:17.851198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 345/690] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:13:17 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:18.704475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:18.705209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:18.712055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:18.712566 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:18.713000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:18.713689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:18.714139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:18.714562 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:18.847508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:18.855148 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-57a5ffae-2942-4418-a515-17c72951e725 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1575 microversion: 2.1 time: 0.154855 Sep 09 21:13:18.855716 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 346/691] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:18 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:18.862742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:18.864970 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:18.871117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:18.871586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:18.872013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:18.872710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:18.873156 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:18.873573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:18.901924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b2039402-003e-48b4-90b3-fce97a40cec8 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 Sep 09 21:13:18.902460 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 346/692] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:13:18 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:19.878365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:19.878892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:19.885271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:19.885754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:19.886185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:19.886878 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:19.887327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:19.887746 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:19.914564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:19.917138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:19.923942 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:19.924583 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:19.925692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:19.926462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:19.926990 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:19.927487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:19.960951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1dd0d794-7c2a-47aa-b3fe-47c72732ed90 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050334 Sep 09 21:13:19.961635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 347/693] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:13:19 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 21:13:20.030949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:20.042870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-99537773-1793-492b-a325-afd9efb8da9e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1575 microversion: 2.1 time: 0.168365 Sep 09 21:13:20.043453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 347/694] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:19 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:20.055324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:20.056110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:20.062499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:20.064852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:20.064852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:20.064852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:20.064852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:20.065296 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:20.090019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:13:20.302826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4967cc40-725a-40ce-bc85-7fed4b403b58 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 204 len: 0 microversion: 2.1 time: 0.261147 Sep 09 21:13:20.308864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 348/695] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:13:20 2022] DELETE /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 21:13:20.311528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:20.312166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:20.318844 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:20.319324 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:20.319760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:20.320611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:20.321103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:20.321527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:20.451620 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-a9c52024-3865-4e4e-b287-f195fe83d288 req-3ac480cd-247b-4f3e-9f79-36baaf1d8d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc24ffe5-abae-40e0-95af-cd8318ed087b", "name": "network-vif-deleted", "tag": "71413cdd-30b3-4d21-af8d-e26190318499"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:20.454336 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:20.462370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a9c52024-3865-4e4e-b287-f195fe83d288 req-3ac480cd-247b-4f3e-9f79-36baaf1d8d5e service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:20.462849 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a9c52024-3865-4e4e-b287-f195fe83d288 req-3ac480cd-247b-4f3e-9f79-36baaf1d8d5e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:20.463100 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9c70a7bd-bbf4-483f-9cc9-7a480ca31f84 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1688 microversion: 2.1 time: 0.155441 Sep 09 21:13:20.463478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a9c52024-3865-4e4e-b287-f195fe83d288 req-3ac480cd-247b-4f3e-9f79-36baaf1d8d5e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:20.470958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 348/696] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:20 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:20.475779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-a9c52024-3865-4e4e-b287-f195fe83d288 req-3ac480cd-247b-4f3e-9f79-36baaf1d8d5e service nova] Creating event network-vif-deleted:71413cdd-30b3-4d21-af8d-e26190318499 for instance fc24ffe5-abae-40e0-95af-cd8318ed087b on hv-cinder-83124 Sep 09 21:13:20.480644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-a9c52024-3865-4e4e-b287-f195fe83d288 req-3ac480cd-247b-4f3e-9f79-36baaf1d8d5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Sep 09 21:13:20.481225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 349/697] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:13:21.066622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:21.067246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:21.073561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:21.074040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:21.074476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:21.075170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:21.075619 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:21.076040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:21.094520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:21.142061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:21.148270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a763c3a9-4e3d-4160-b0ad-94f134b5831b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1509 microversion: 2.1 time: 0.085461 Sep 09 21:13:21.148840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 349/698] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:21 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:21.488844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:21.489547 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:21.495846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:21.496374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:21.496844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:21.497544 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:21.498002 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:21.498428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:21.625171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:21.632882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-117c8559-1c84-415c-97d6-382237bd4de9 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1688 microversion: 2.1 time: 0.149623 Sep 09 21:13:21.633440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 350/699] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:21 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:22.172931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:22.173540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:22.180158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:22.180666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:22.181094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:22.181773 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:22.182264 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:22.182682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:22.243025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:22.250554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f59a13c4-6d22-46c6-b858-55e7003bfe4f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1509 microversion: 2.1 time: 0.081879 Sep 09 21:13:22.251111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 350/700] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:22 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1509 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:22.655816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:22.656489 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:22.662911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:22.663394 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:22.663832 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:22.664560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:22.665014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:22.665436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:22.669533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:22.798663 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:22.808053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-69af2064-4c93-447b-b0b0-5b4660345a2f tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1688 microversion: 2.1 time: 0.155875 Sep 09 21:13:22.808700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 351/701] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:22 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:23.274916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:23.275531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:23.281543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:23.282039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:23.282462 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:23.283143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:23.283596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:23.284016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:23.348411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:23.356002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-020f2bca-303b-4eab-8906-808efc04056c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 200 len: 1225 microversion: 2.1 time: 0.085075 Sep 09 21:13:23.356594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 351/702] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:23 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:23.839025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:23.839617 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:23.846536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:23.855737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:23.855737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:23.855737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:23.855737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:23.856191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:23.997445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:24.012603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6261c11f-561d-4789-9088-a95322a64806 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1688 microversion: 2.1 time: 0.177460 Sep 09 21:13:24.013178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 352/703] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:23 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:24.214237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-dd103d46-c6e8-48ed-b83e-8431bbdca1d1 req-e4f63ab5-e5a8-476f-b7e1-e5890466ca4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adcea70-5a82-48c8-9a07-54f1550e17f5", "name": "network-vif-deleted", "tag": "499398d4-9eb5-4074-b98e-a0efaafdc265"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:24.235365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-dd103d46-c6e8-48ed-b83e-8431bbdca1d1 req-e4f63ab5-e5a8-476f-b7e1-e5890466ca4b service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:24.235851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-dd103d46-c6e8-48ed-b83e-8431bbdca1d1 req-e4f63ab5-e5a8-476f-b7e1-e5890466ca4b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:24.236310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-dd103d46-c6e8-48ed-b83e-8431bbdca1d1 req-e4f63ab5-e5a8-476f-b7e1-e5890466ca4b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:24.250838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-dd103d46-c6e8-48ed-b83e-8431bbdca1d1 req-e4f63ab5-e5a8-476f-b7e1-e5890466ca4b service nova] Creating event network-vif-deleted:499398d4-9eb5-4074-b98e-a0efaafdc265 for instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 on hv-cinder-83124 Sep 09 21:13:24.255053 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-dd103d46-c6e8-48ed-b83e-8431bbdca1d1 req-e4f63ab5-e5a8-476f-b7e1-e5890466ca4b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044506 Sep 09 21:13:24.256241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 352/704] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:24.378850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:24.379728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:24.386382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:24.386884 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:24.387331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:24.388049 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:24.389112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:24.389727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:24.407257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] HTTP exception thrown: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Request method failure captured: Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b HTTP/1.1 Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6s2RaZp0YltFHZJQPw9xGdVMsvbDiu3JeiD8HObs9cGDSDje66ChS0gAaMD7XXlLWvtDqhIa83W6kZRhxh9v1HdXi06VrdvbcHuArZH9do950dzRDvl4XUUzLOaPzSgd-pO0GtMIzybAWPwudjiz8ZD5xIaSKzfmFMEoXTxb7nHjDY Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:13:24.419943 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-TestVolumeBootPattern-91379462 Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: f289a1bdd79b4ba0bf9499edb7729c9a Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:13:24.421597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'fc24ffe5-abae-40e0-95af-cd8318ed087b'} Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:13:24.422561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:13:24.424904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:24.426258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Returning 404 to user: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:13:24.426258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-91391a82-172e-49a6-8443-1d651f47f6ee tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 404 len: 111 microversion: 2.1 time: 0.036603 Sep 09 21:13:24.426258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 353/705] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:24 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:13:24.497751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-707628701", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-704010936", "security_groups": [{"name": "tempest-secgroup-smoke-27864544"}], "block_device_mapping_v2": [{"uuid": "c469fa5e-386f-4c78-81ec-7cdb9764590a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca317ead-021d-4181-81fb-569564a685ee"}]}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:24.618347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] validate_networks() for [('ca317ead-021d-4181-81fb-569564a685ee', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:13:25.032949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:13:25.033375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:13:25.034187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:13:25.034611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:13:25.035033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:13:25.038020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:25.038521 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:25.045017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:25.045301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:25.045798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:25.045941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:25.046235 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:25.046356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:25.046972 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:25.047083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:25.047429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:25.047540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:25.047858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:25.047975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:25.072692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:13:25.078420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for user f289a1bdd79b4ba0bf9499edb7729c9a and project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:13:25.083694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:25.084165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:25.084824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:25.085462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lazy-loading 'fault' on Instance uuid 8adcea70-5a82-48c8-9a07-54f1550e17f5 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:13:25.126745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:25.136041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-536bb59e-7e5f-4727-9b33-ac886ee839e4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 200 len: 1336 microversion: 2.1 time: 0.102679 Sep 09 21:13:25.136635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 354/706] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:25 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:25.158877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:13:25.161274 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c469fa5e-386f-4c78-81ec-7cdb9764590a',volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:13:25.573246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f3e3b8a7-f2a2-439f-ba21-5a8b99ead72f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.079731 Sep 09 21:13:25.574054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 353/707] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:13:24 2022] POST /compute/v2.1/servers => generated 404 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:13:25.585539 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-da220fc4-b7a6-4a9a-b48a-ee201c3b431e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:25.586178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-da220fc4-b7a6-4a9a-b48a-ee201c3b431e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:25.639457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-da220fc4-b7a6-4a9a-b48a-ee201c3b431e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:25.646435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-da220fc4-b7a6-4a9a-b48a-ee201c3b431e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1093 microversion: 2.1 time: 0.064775 Sep 09 21:13:25.646996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 355/708] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:25 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:26.160865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:26.161473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: 8adcea70-5a82-48c8-9a07-54f1550e17f5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:26.167932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:26.168446 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:26.168877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:26.169560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:26.170008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:26.170424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:26.183658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] HTTP exception thrown: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 could not be found. Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Request method failure captured: Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 HTTP/1.1 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qVBwptcsDNcMpXRuR0L0x1hK1ma264iEAATbJPo2EBta7NTueIEfkpBnSyyzLWNXoCuwOlZDg3dCZUUupNMPMxinw7dOfz7k_DkchI-ApO_J8wOw2jNs9PWVLO_vRQ19l7QlRucRVD4PUIK2xwJxYyJvVsQ0Fd8dj5HZEiNuDYLR0 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:13:26.185381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25acf91bdf524474b03d44271d08fba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: c764d9778ef74b709cedbccabac37af0 Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 could not be found. Sep 09 21:13:26.186870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '8adcea70-5a82-48c8-9a07-54f1550e17f5'} Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 could not be found. Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:13:26.187657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 could not be found. Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 could not be found. Sep 09 21:13:26.189110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:26.190545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Returning 404 to user: Instance 8adcea70-5a82-48c8-9a07-54f1550e17f5 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:13:26.190545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9119d66e-c853-4190-92c9-f165885f3e01 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5" status: 404 len: 111 microversion: 2.1 time: 0.030666 Sep 09 21:13:26.190545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 354/709] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:26 2022] GET /compute/v2.1/servers/8adcea70-5a82-48c8-9a07-54f1550e17f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:13:26.195702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-14735b5e-0e6c-4aae-a044-148be62c42fc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '.version_select at 0x7fa1d08a6280>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:26.279995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-14735b5e-0e6c-4aae-a044-148be62c42fc tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748114827" status: 202 len: 0 microversion: 2.1 time: 0.087955 Sep 09 21:13:26.280673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 356/710] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Sep 9 21:13:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748114827 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:13:26.668548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:26.669259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:26.676279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:26.676751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:26.677187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:26.677875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:26.678327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:26.678748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:26.746911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:26.754596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-16fc476a-50ce-4296-b1e6-2456ff858541 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1135 microversion: 2.1 time: 0.089859 Sep 09 21:13:26.755155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 355/711] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:26 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1135 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:27.778439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:27.779055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:27.785448 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:27.785938 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:27.786429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:27.787413 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:27.788027 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:27.788484 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:27.854053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:27.863131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2fb38b32-b994-46e1-9ab3-f3d43d2e46b4 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1199 microversion: 2.1 time: 0.088774 Sep 09 21:13:27.863687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 357/712] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:27 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1199 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:27.995533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:27.997790 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:28.004179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.004650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.005078 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.005765 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.006211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.006629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.038322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-08343c91-6dd7-4ede-a363-794c4883f445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044041 Sep 09 21:13:28.038322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 356/713] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:13:27 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:13:28.099163 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:28.099667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:28.105526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.106014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.106451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.107145 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.107602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.108026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.133123 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:13:28.434236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6f82274a-9206-4659-bf07-83e6256ea66d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 204 len: 0 microversion: 2.1 time: 0.339147 Sep 09 21:13:28.436678 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 358/714] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:13:28 2022] DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:13:28.445310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:28.446065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:28.453506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.454704 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.455194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.456032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.456783 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.457213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.609860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:28.621322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-83fbfaa2-ec18-4d0b-a357-02bef6ece071 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1674 microversion: 2.1 time: 0.180413 Sep 09 21:13:28.636386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 357/715] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:28 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:28.887730 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:28.891701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:28.898509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.899157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.899801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:28.900624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:28.901180 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:28.901705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:29.057698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:29.066170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-61ef5882-b5e2-4646-b0d7-44d8343960bf tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1275 microversion: 2.1 time: 0.182150 Sep 09 21:13:29.066848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 359/716] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:28 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:29.652369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:29.652369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:29.654606 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:29.655089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:29.655520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:29.656251 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:29.656703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:29.657130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:29.713372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:29.713372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:29.714359 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:29.714875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:29.715306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:29.716016 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:29.716494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:29.716914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:29.743312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:13:29.795809 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:29.803796 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-75e6e947-c503-4a1c-ac27-9046b9ecf74a tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1674 microversion: 2.1 time: 0.160362 Sep 09 21:13:29.804397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 358/717] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:29 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:29.993235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-143a4abc-fe0a-4771-8377-d35cb8ecda22 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 204 len: 0 microversion: 2.1 time: 0.293305 Sep 09 21:13:29.993923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 360/718] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:13:29 2022] DELETE /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:13:30.001841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:30.003718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:30.009356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:30.010829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.011256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.011889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.012818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.014054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.014506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.090837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:30.091643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:30.098968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.099450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.100059 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.100792 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.101241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.101714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.163312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:30.172039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f4d2b558-cbd0-4ba1-b42c-8402c8fb644d tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1506 microversion: 2.1 time: 0.174044 Sep 09 21:13:30.172638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 359/719] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:29 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:30.178139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-4e07aa81-8cfa-4781-97f2-5d9cf1fe9ca3 req-f4ddec61-75da-40ab-861e-e1f0a4971540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08119519-4899-4fcf-9b2a-fea5c47e64f8", "tag": "36c919a2-d5cb-47bb-9b31-f9be3e317c67"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:30.189045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-4e07aa81-8cfa-4781-97f2-5d9cf1fe9ca3 req-f4ddec61-75da-40ab-861e-e1f0a4971540 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.189665 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-4e07aa81-8cfa-4781-97f2-5d9cf1fe9ca3 req-f4ddec61-75da-40ab-861e-e1f0a4971540 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.190120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-4e07aa81-8cfa-4781-97f2-5d9cf1fe9ca3 req-f4ddec61-75da-40ab-861e-e1f0a4971540 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.202218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-4e07aa81-8cfa-4781-97f2-5d9cf1fe9ca3 req-f4ddec61-75da-40ab-861e-e1f0a4971540 service nova] Creating event network-changed:36c919a2-d5cb-47bb-9b31-f9be3e317c67 for instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 on hv-cinder-83124 Sep 09 21:13:30.207962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-4e07aa81-8cfa-4781-97f2-5d9cf1fe9ca3 req-f4ddec61-75da-40ab-861e-e1f0a4971540 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033944 Sep 09 21:13:30.215583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 360/720] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:30.264158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:30.271878 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-21c0117e-331f-4d19-8334-ed643525b670 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1275 microversion: 2.1 time: 0.185355 Sep 09 21:13:30.272469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 361/721] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:30 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:30.828832 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:30.830127 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:30.836534 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.837025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.837461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.838159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:30.838612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:30.839064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:30.968871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:30.977199 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5cfc6cca-944f-463f-adb8-db30bf6532ec tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1674 microversion: 2.1 time: 0.153425 Sep 09 21:13:30.977767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 361/722] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:30 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:31.196286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:31.197606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:31.201189 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:31.208780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:31.208780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:31.208780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:31.208780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:31.209164 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:31.209164 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:31.295479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:31.296141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:31.304117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:31.304644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:31.305099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:31.305864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:31.306406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:31.308381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:31.533614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:31.547816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bffe1ae6-4bd8-4282-8db1-8b521b4d3a8e tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1506 microversion: 2.1 time: 0.355494 Sep 09 21:13:31.548507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 362/723] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:31 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:31.602601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:31.612304 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-78560074-662c-4b65-9ca7-6218e110672c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1263 microversion: 2.1 time: 0.320669 Sep 09 21:13:31.612977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 362/724] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:31 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1263 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:31.924002 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-a906b5fb-5a7e-4432-83a1-d0876ed0cc68 req-10fb3a1f-d1e0-4dd2-8956-73a854bf3cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e49d1f-fff6-4f7f-9659-e49238a5bcde", "name": "network-vif-deleted", "tag": "866a955a-0fc1-4fec-8c0f-a92a0f9f0d1d"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:31.933874 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a906b5fb-5a7e-4432-83a1-d0876ed0cc68 req-10fb3a1f-d1e0-4dd2-8956-73a854bf3cde service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:31.934285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a906b5fb-5a7e-4432-83a1-d0876ed0cc68 req-10fb3a1f-d1e0-4dd2-8956-73a854bf3cde service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:31.934715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-a906b5fb-5a7e-4432-83a1-d0876ed0cc68 req-10fb3a1f-d1e0-4dd2-8956-73a854bf3cde service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:31.946244 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-a906b5fb-5a7e-4432-83a1-d0876ed0cc68 req-10fb3a1f-d1e0-4dd2-8956-73a854bf3cde service nova] Creating event network-vif-deleted:866a955a-0fc1-4fec-8c0f-a92a0f9f0d1d for instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde on hv-cinder-83124 Sep 09 21:13:31.951116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-a906b5fb-5a7e-4432-83a1-d0876ed0cc68 req-10fb3a1f-d1e0-4dd2-8956-73a854bf3cde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 Sep 09 21:13:31.951712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 363/725] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:32.000715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:32.002058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:32.009107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.009605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.010043 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.010748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.011202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.011629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.073798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:32.082438 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ee3a53c6-1497-4c07-ade2-5b3f2c9a5a6d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1606 microversion: 2.1 time: 0.085585 Sep 09 21:13:32.083018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 363/726] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:31 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:32.223926 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-73aaab12-b3fc-49ab-ad44-b7ca2c53997c req-7df44d4a-2da3-49e2-91e5-53a5c47116a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f14bf7b-dd56-44e0-bd6a-cd546c3956ca", "name": "network-vif-deleted", "tag": "24603941-285a-42e6-adac-2398e3dbcba9"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:32.235161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-73aaab12-b3fc-49ab-ad44-b7ca2c53997c req-7df44d4a-2da3-49e2-91e5-53a5c47116a3 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.235971 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-73aaab12-b3fc-49ab-ad44-b7ca2c53997c req-7df44d4a-2da3-49e2-91e5-53a5c47116a3 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.236883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-73aaab12-b3fc-49ab-ad44-b7ca2c53997c req-7df44d4a-2da3-49e2-91e5-53a5c47116a3 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.250196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-73aaab12-b3fc-49ab-ad44-b7ca2c53997c req-7df44d4a-2da3-49e2-91e5-53a5c47116a3 service nova] Creating event network-vif-deleted:24603941-285a-42e6-adac-2398e3dbcba9 for instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca on hv-cinder-83124 Sep 09 21:13:32.256103 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-73aaab12-b3fc-49ab-ad44-b7ca2c53997c req-7df44d4a-2da3-49e2-91e5-53a5c47116a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036124 Sep 09 21:13:32.260666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 364/727] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:13:32.577044 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:32.577971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:32.586304 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.587176 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.588480 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.589393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.590545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.591135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.636150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:32.636852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:32.644050 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.644762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.645301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.646152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:32.646700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:32.647235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:32.667511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:32.676018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d94add42-846d-43f9-aade-b82ae3502cb4 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1292 microversion: 2.1 time: 0.108208 Sep 09 21:13:32.677543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 364/728] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:32 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:32.781097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:32.789243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-661aa20a-915d-43fa-bd38-f7466a42c908 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1263 microversion: 2.1 time: 0.157183 Sep 09 21:13:32.790069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 365/729] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:32 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:33.105440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:33.106045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:33.112955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:33.113429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:33.113856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:33.114537 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:33.114988 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:33.115405 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:33.178276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:33.185826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e52a7cbc-f52b-4d0c-9d7c-071f3162cb88 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1322 microversion: 2.1 time: 0.084260 Sep 09 21:13:33.186799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 365/730] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:33 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1322 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:33.698960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:33.699876 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:33.708208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:33.708700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:33.709135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:33.710055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:33.710670 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:33.711255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:33.778669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:33.787163 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-59c239e4-66f0-44f7-8f12-bb439a3fb781 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1292 microversion: 2.1 time: 0.092229 Sep 09 21:13:33.787812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 366/731] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:33 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:33.813640 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:33.814585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:33.821686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:33.822486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:33.822922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:33.823661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:33.824130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:33.824553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.044000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:34.052330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-db52d997-325f-4f49-af01-3d228c8de9e7 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1263 microversion: 2.1 time: 0.243075 Sep 09 21:13:34.052981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 366/732] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:33 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1263 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:34.210229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:34.210836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:34.216743 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:34.217223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:34.217660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.218346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:34.218799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:34.219222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.250200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:34.250624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:34.251041 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.251480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lazy-loading 'fault' on Instance uuid 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:13:34.294346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:34.297829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:34.302430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7c72337c-4dc9-4f9c-8012-4f235960116d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 200 len: 1327 microversion: 2.1 time: 0.096699 Sep 09 21:13:34.302998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 367/733] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:34 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:34.809310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:34.809926 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:34.816425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:34.816920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:34.817440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.818460 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:34.819268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:34.819852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.852501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:34.852873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:34.853301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:34.853743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lazy-loading 'fault' on Instance uuid c3e49d1f-fff6-4f7f-9659-e49238a5bcde {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:13:34.898431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:34.906204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d6190b00-f1a2-41c5-9359-d27f2b2f9786 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 200 len: 1311 microversion: 2.1 time: 0.100733 Sep 09 21:13:34.906771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 367/734] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:34 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:35.076233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:35.077298 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:35.084995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.097903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.097903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.097903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.097903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.098318 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.229885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:35.237645 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-462f7004-aabf-4525-a01c-234e000dd213 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1263 microversion: 2.1 time: 0.165102 Sep 09 21:13:35.238224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 368/735] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:35 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:35.325998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:35.326689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:35.328579 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:35.329515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:35.335094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.338882 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.338882 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.338882 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.338882 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.339325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.352904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] HTTP exception thrown: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Request method failure captured: Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca HTTP/1.1 Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qfPpaR9jo0WH84ZTs4mUYrHQ4k_dTZDGHPEBXpbYtWHcgdSJinUsp7gazN8W-fHE43Ap2GIsLANGhfsPAyS6DPFhFkeTj-qr0z1WDYf1u6x6a8e38kCEhzpItbXXFY77JXxXZJlO-0v9BH5oGi8T-haNNEpIeh1jxupV4QJxto4nc Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:13:35.354559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: e3ef96f764244e5893f16a74d4169edb Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:13:35.356292 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '0f14bf7b-dd56-44e0-bd6a-cd546c3956ca'} Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:13:35.360818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:13:35.362310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.363674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Returning 404 to user: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:13:35.363674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-47b7929d-2501-491a-9c64-a60b606dee99 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 404 len: 111 microversion: 2.1 time: 0.034113 Sep 09 21:13:35.363674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 368/736] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:35 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:13:35.366186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b0ac8255-b27d-4d0f-9908-c6d263851a27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '.version_select at 0x7fa1d08b0d30>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:35.497467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b0ac8255-b27d-4d0f-9908-c6d263851a27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654615978" status: 202 len: 0 microversion: 2.1 time: 0.136133 Sep 09 21:13:35.497947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 369/737] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Sep 9 21:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654615978 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:13:35.745306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-c5b1644c-8c7b-48f8-a6a0-d1ecd35a49c2 req-ce1128c6-4ced-4fa9-9780-321b5d4587b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08119519-4899-4fcf-9b2a-fea5c47e64f8", "name": "network-vif-plugged", "status": "completed", "tag": "36c919a2-d5cb-47bb-9b31-f9be3e317c67"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:35.758023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-c5b1644c-8c7b-48f8-a6a0-d1ecd35a49c2 req-ce1128c6-4ced-4fa9-9780-321b5d4587b9 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.762974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-c5b1644c-8c7b-48f8-a6a0-d1ecd35a49c2 req-ce1128c6-4ced-4fa9-9780-321b5d4587b9 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.762974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-c5b1644c-8c7b-48f8-a6a0-d1ecd35a49c2 req-ce1128c6-4ced-4fa9-9780-321b5d4587b9 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.762974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:35.770909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-c5b1644c-8c7b-48f8-a6a0-d1ecd35a49c2 req-ce1128c6-4ced-4fa9-9780-321b5d4587b9 service nova] Creating event network-vif-plugged:36c919a2-d5cb-47bb-9b31-f9be3e317c67 for instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 on hv-cinder-83124 Sep 09 21:13:35.775984 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-c5b1644c-8c7b-48f8-a6a0-d1ecd35a49c2 req-ce1128c6-4ced-4fa9-9780-321b5d4587b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037707 Sep 09 21:13:35.776646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 369/738] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:35.927055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:35.931116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:35.931765 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: c3e49d1f-fff6-4f7f-9659-e49238a5bcde] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:35.937954 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.938452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.940711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.940711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.940921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.941194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.957227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] HTTP exception thrown: Instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde could not be found. Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Request method failure captured: Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde HTTP/1.1 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qVBwptcsDNcMpXRuR0L0x1hK1ma264iEAATbJPo2EBta7NTueIEfkpBnSyyzLWNXoCuwOlZDg3dCZUUupNMPMxinw7dOfz7k_DkchI-ApO_J8wOw2jNs9PWVLO_vRQ19l7QlRucRVD4PUIK2xwJxYyJvVsQ0Fd8dj5HZEiNuDYLR0 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:13:35.958903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25acf91bdf524474b03d44271d08fba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: c764d9778ef74b709cedbccabac37af0 Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde could not be found. Sep 09 21:13:35.960467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'c3e49d1f-fff6-4f7f-9659-e49238a5bcde'} Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde could not be found. Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:13:35.961403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde could not be found. Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde could not be found. Sep 09 21:13:35.962828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:35.964559 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Returning 404 to user: Instance c3e49d1f-fff6-4f7f-9659-e49238a5bcde could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:13:35.964559 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4caf24de-964e-4f83-88e5-44d55664edb3 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde" status: 404 len: 111 microversion: 2.1 time: 0.034029 Sep 09 21:13:35.964559 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 370/739] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:35 2022] GET /compute/v2.1/servers/c3e49d1f-fff6-4f7f-9659-e49238a5bcde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:13:35.974101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:35.974710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:35.986642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.987726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.988202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:35.988916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:35.989371 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:35.989797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:36.021703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:13:36.263603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:36.264345 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:36.272316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:36.272867 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:36.273406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:36.274209 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:36.274790 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:36.275295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:36.331485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-42c4aa25-48da-4589-ac36-8e69c4775f72 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 204 len: 0 microversion: 2.1 time: 0.361917 Sep 09 21:13:36.332383 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 370/740] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:13:35 2022] DELETE /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:13:36.347852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:36.348621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:36.354868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:36.355364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:36.355843 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:36.356777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:36.357246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:36.357672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:36.500990 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:36.511234 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-49cc1756-8d4e-4fab-97ab-90f0cf06394d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1263 microversion: 2.1 time: 0.253219 Sep 09 21:13:36.511808 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 371/741] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:36 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1263 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:36.593358 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:36.603428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0e74e2bc-52aa-4f67-9708-9929678bf494 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.259725 Sep 09 21:13:36.604288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 371/742] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:36 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:36.634101 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-79cb11b3-26c1-42d2-acac-412b241c09cf tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: .version_select at 0x7fa1d08850d0>, body: {"keypair": {"name": "tempest-keypair-262106309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRl6wMpPlXXg8W6W7X+S88I5QSlYvC4vUYGmndHwUB11euxOsP/60B/9eabkb6IDfmGezbH+ZkdiEQSkLyGAq5GqTkIq8fA6517O4zjyDghFxy/1V5Y26G4yQnkiz7YAA=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:36.649505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-79cb11b3-26c1-42d2-acac-412b241c09cf tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:13:36.653243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-79cb11b3-26c1-42d2-acac-412b241c09cf tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for user e3ef96f764244e5893f16a74d4169edb and project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:13:36.719746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-79cb11b3-26c1-42d2-acac-412b241c09cf tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089487 Sep 09 21:13:36.720376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 372/743] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:13:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:37.535111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:37.535726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:37.542230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:37.542712 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:37.543148 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:37.543837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:37.544316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:37.544741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:37.628315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:37.628925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:37.634944 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:37.635428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:37.635882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:37.636584 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:37.637032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:37.637462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:37.734396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:37.742745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-718c2f77-8a92-4834-ac20-14e352f962b6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1263 microversion: 2.1 time: 0.211586 Sep 09 21:13:37.743320 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 372/744] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:37 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1263 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:37.883478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:37.891143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ed5f69c3-531b-4223-913c-30e92ce8a51c tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1521 microversion: 2.1 time: 0.267987 Sep 09 21:13:37.891708 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 373/745] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:37 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:38.646826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-695432cd-2f28-4dc5-ac61-4d5a93d1469c req-25f29d1f-5f05-46f0-aa6d-33fd035665e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb100de-b697-4ed6-9765-b93b4e58cf88", "name": "network-vif-deleted", "tag": "4ea9245f-7a66-4720-af56-8bdcc46162f8"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:38.657299 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-695432cd-2f28-4dc5-ac61-4d5a93d1469c req-25f29d1f-5f05-46f0-aa6d-33fd035665e6 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:38.657774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-695432cd-2f28-4dc5-ac61-4d5a93d1469c req-25f29d1f-5f05-46f0-aa6d-33fd035665e6 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:38.658198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-695432cd-2f28-4dc5-ac61-4d5a93d1469c req-25f29d1f-5f05-46f0-aa6d-33fd035665e6 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:38.672000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-695432cd-2f28-4dc5-ac61-4d5a93d1469c req-25f29d1f-5f05-46f0-aa6d-33fd035665e6 service nova] Creating event network-vif-deleted:4ea9245f-7a66-4720-af56-8bdcc46162f8 for instance cdb100de-b697-4ed6-9765-b93b4e58cf88 on hv-cinder-83124 Sep 09 21:13:38.677657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-695432cd-2f28-4dc5-ac61-4d5a93d1469c req-25f29d1f-5f05-46f0-aa6d-33fd035665e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034620 Sep 09 21:13:38.683153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 373/746] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:38.765307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:38.766292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:38.772419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:38.772911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:38.773332 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:38.774033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:38.774483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:38.774904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:38.916262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:38.917031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:38.923742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:38.925138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:38.925668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:38.927919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:38.928555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:38.929167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:39.035255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c764d9778ef74b709cedbccabac37af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25acf91bdf524474b03d44271d08fba6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:39.043561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:39.052850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d5efa13b-b611-45f4-a38b-2010f9096e4b tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 200 len: 1306 microversion: 2.1 time: 0.141341 Sep 09 21:13:39.057372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5156b8f6-bfec-41e3-9df2-6d97ee3a9301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1449 microversion: 2.1 time: 0.295960 Sep 09 21:13:39.058394 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 374/747] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:38 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1449 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:39.062749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 374/748] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:38 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:39.085554 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:39.086166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:39.091883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:39.092442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:39.092898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:39.093586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:39.094216 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:39.094636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:39.307722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:39.317000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b6594025-a4bc-47d6-ab32-8b40e34706a3 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1449 microversion: 2.1 time: 0.235181 Sep 09 21:13:39.317563 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 375/749] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:39 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1449 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:39.472032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1493939340", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57892a79-334e-4e74-97e6-1b8cb5d8cb77"}], "security_groups": [{"name": "tempest-securitygroup--527801142"}], "key_name": "tempest-keypair-262106309", "user_data": "}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:39.633826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] validate_networks() for [('57892a79-334e-4e74-97e6-1b8cb5d8cb77', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:13:40.076361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:40.077124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] [instance: cdb100de-b697-4ed6-9765-b93b4e58cf88] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:40.084400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:40.084893 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:40.085325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:40.086020 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:40.086475 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:40.086900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:40.101998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] HTTP exception thrown: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 could not be found. Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Request method failure captured: Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 HTTP/1.1 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qVBwptcsDNcMpXRuR0L0x1hK1ma264iEAATbJPo2EBta7NTueIEfkpBnSyyzLWNXoCuwOlZDg3dCZUUupNMPMxinw7dOfz7k_DkchI-ApO_J8wOw2jNs9PWVLO_vRQ19l7QlRucRVD4PUIK2xwJxYyJvVsQ0Fd8dj5HZEiNuDYLR0 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:13:40.103736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/25acf91bdf524474b03d44271d08fba6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_25acf91bdf524474b03d44271d08fba6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 25acf91bdf524474b03d44271d08fba6 Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-794897680 Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: c764d9778ef74b709cedbccabac37af0 Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-ServerRescueNegativeTestJSON-794897680-project Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 could not be found. Sep 09 21:13:40.105485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'cdb100de-b697-4ed6-9765-b93b4e58cf88'} Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 could not be found. Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:13:40.106370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 could not be found. Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 could not be found. Sep 09 21:13:40.107798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:13:40.109789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] Returning 404 to user: Instance cdb100de-b697-4ed6-9765-b93b4e58cf88 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:13:40.109789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-975c6e7a-fff9-4bc0-a47f-75576663eb43 tempest-ServerRescueNegativeTestJSON-794897680 tempest-ServerRescueNegativeTestJSON-794897680-project] 10.222.0.48 "GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88" status: 404 len: 111 microversion: 2.1 time: 0.032635 Sep 09 21:13:40.109789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 376/750] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:40 2022] GET /compute/v2.1/servers/cdb100de-b697-4ed6-9765-b93b4e58cf88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:13:40.229677 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:13:40.230250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:13:40.230865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:13:40.231494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:13:40.231911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:13:40.242994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:40.244604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:40.248212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:40.248212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:40.248212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:40.248212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:40.271519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:13:40.276565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Getting quotas for user e3ef96f764244e5893f16a74d4169edb and project d9f70ceb84fc40fbb499b6a80bc5c13b. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:13:40.287399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:13:40.289828 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:13:40.403258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-74a5bf6a-03aa-4e5e-92f5-f3db3562852c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.935293 Sep 09 21:13:40.404250 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 375/751] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:13:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:13:40.416200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1921e0ec-b1a5-43bd-8e0e-ec5c2c05c235 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:40.416816 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1921e0ec-b1a5-43bd-8e0e-ec5c2c05c235 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:40.503167 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1921e0ec-b1a5-43bd-8e0e-ec5c2c05c235 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:40.509927 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1921e0ec-b1a5-43bd-8e0e-ec5c2c05c235 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1237 microversion: 2.1 time: 0.097932 Sep 09 21:13:40.521571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 377/752] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:40 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:41.534308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:41.534934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:41.542251 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:41.542793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:41.543237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:41.543943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:41.544430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:41.544860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:41.616785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:41.627293 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-317dad82-0cc8-4056-941a-3fea49c09623 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1241 microversion: 2.1 time: 0.097360 Sep 09 21:13:41.628208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 376/753] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:41 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:41.890078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-f81ccc37-82c6-4729-ae07-c160ce1dfb3a req-1c716406-bc5b-4f38-b46f-87c629656dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08119519-4899-4fcf-9b2a-fea5c47e64f8", "tag": "36c919a2-d5cb-47bb-9b31-f9be3e317c67"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:41.914142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f81ccc37-82c6-4729-ae07-c160ce1dfb3a req-1c716406-bc5b-4f38-b46f-87c629656dd2 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:41.915573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f81ccc37-82c6-4729-ae07-c160ce1dfb3a req-1c716406-bc5b-4f38-b46f-87c629656dd2 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:41.916215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f81ccc37-82c6-4729-ae07-c160ce1dfb3a req-1c716406-bc5b-4f38-b46f-87c629656dd2 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:41.929724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-f81ccc37-82c6-4729-ae07-c160ce1dfb3a req-1c716406-bc5b-4f38-b46f-87c629656dd2 service nova] Creating event network-changed:36c919a2-d5cb-47bb-9b31-f9be3e317c67 for instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 on hv-cinder-83124 Sep 09 21:13:41.936554 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-f81ccc37-82c6-4729-ae07-c160ce1dfb3a req-1c716406-bc5b-4f38-b46f-87c629656dd2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052419 Sep 09 21:13:41.937385 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 378/754] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:42.650834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:42.651592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:42.669280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:42.669795 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:42.670373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:42.674069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:42.674069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:42.674069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:42.881069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:42.896356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-29f854e7-b0eb-4569-a37f-2f6d7bcee7a5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1297 microversion: 2.1 time: 0.249723 Sep 09 21:13:42.903753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 377/755] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:42 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1297 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:43.921183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:43.921889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:43.933969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:43.934458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:43.934899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:43.935608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:43.936055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:43.936556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:44.192629 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:44.202339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8cef559a-cbf0-4433-820a-013c5d1d41f0 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.285424 Sep 09 21:13:44.203880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 379/756] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:43 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:44.975493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-56d15a83-994f-47be-b21c-4e8059e3665b req-f4986a1b-2d5d-411e-aa61-06441b2bfbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af5f313-0ae0-4c98-8823-c398127b8fd1", "tag": "0e3cc85d-c58f-404a-a9e9-c823c8cd640b"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:44.995551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-56d15a83-994f-47be-b21c-4e8059e3665b req-f4986a1b-2d5d-411e-aa61-06441b2bfbb1 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:44.996395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-56d15a83-994f-47be-b21c-4e8059e3665b req-f4986a1b-2d5d-411e-aa61-06441b2bfbb1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:44.997001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-56d15a83-994f-47be-b21c-4e8059e3665b req-f4986a1b-2d5d-411e-aa61-06441b2bfbb1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:45.010672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-56d15a83-994f-47be-b21c-4e8059e3665b req-f4986a1b-2d5d-411e-aa61-06441b2bfbb1 service nova] Creating event network-changed:0e3cc85d-c58f-404a-a9e9-c823c8cd640b for instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 on hv-cinder-83124 Sep 09 21:13:45.015886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-56d15a83-994f-47be-b21c-4e8059e3665b req-f4986a1b-2d5d-411e-aa61-06441b2bfbb1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046389 Sep 09 21:13:45.016684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 378/757] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:45.226823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:45.227435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:45.234227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:45.234718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:45.235149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:45.235857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:45.236363 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:45.237317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:45.418106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:45.427056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-14447e04-9c95-4dca-9c4f-e90273ce3f0b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.203596 Sep 09 21:13:45.427567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 380/758] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:45 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:46.450383 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:46.451089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:46.457911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:46.458395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:46.458831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:46.459523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:46.459977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:46.460430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:46.590159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:46.598633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f3537ed4-c63f-488e-a677-385af578d508 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.152800 Sep 09 21:13:46.607618 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 379/759] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:46 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:47.621363 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:47.621903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:47.628351 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:47.628826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:47.629258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:47.630015 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:47.630466 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:47.630886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:47.764491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:47.772165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-085e4a22-7c66-4c45-88ab-b68d2aa1f3c8 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.154950 Sep 09 21:13:47.772980 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 381/760] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:47 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:48.794810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:48.795427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:48.801852 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:48.802362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:48.802802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:48.803498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:48.803961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:48.804413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:48.928028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:48.935536 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-05bdbb84-c18e-4954-ab4f-aa68ba31640b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.144618 Sep 09 21:13:48.936122 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 380/761] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:48 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:49.958429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:49.961382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:49.965499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:49.965961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:49.966389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:49.967068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:49.967616 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:49.968026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:50.096486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:50.104861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6c6bd866-21b2-410c-a10a-a9a96a580ed9 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.150746 Sep 09 21:13:50.105412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 382/762] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:49 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:51.126542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:51.127192 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:51.130218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:51.130885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:51.135818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:51.136343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:51.136784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:51.137542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:51.138015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:51.138439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:51.267354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:51.274924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8e3c3a63-98a8-4655-b010-2b817e0596fa tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.152212 Sep 09 21:13:51.275488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 381/763] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:51 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:51.847897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-85ab11fa-00e5-4bf0-81e2-2447d6e80d89 req-3ff62f63-5f53-43db-ac8e-c105996940f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af5f313-0ae0-4c98-8823-c398127b8fd1", "name": "network-vif-plugged", "status": "completed", "tag": "0e3cc85d-c58f-404a-a9e9-c823c8cd640b"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:13:51.853551 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:13:51.858665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-85ab11fa-00e5-4bf0-81e2-2447d6e80d89 req-3ff62f63-5f53-43db-ac8e-c105996940f4 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:51.859221 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-85ab11fa-00e5-4bf0-81e2-2447d6e80d89 req-3ff62f63-5f53-43db-ac8e-c105996940f4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:51.859647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-85ab11fa-00e5-4bf0-81e2-2447d6e80d89 req-3ff62f63-5f53-43db-ac8e-c105996940f4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:51.870148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-85ab11fa-00e5-4bf0-81e2-2447d6e80d89 req-3ff62f63-5f53-43db-ac8e-c105996940f4 service nova] Creating event network-vif-plugged:0e3cc85d-c58f-404a-a9e9-c823c8cd640b for instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 on hv-cinder-83124 Sep 09 21:13:51.875339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-85ab11fa-00e5-4bf0-81e2-2447d6e80d89 req-3ff62f63-5f53-43db-ac8e-c105996940f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Sep 09 21:13:51.881548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 383/764] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:13:52.298633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:52.300241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:52.307800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:52.308413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:52.308930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:52.309833 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:52.310372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:52.310873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:52.441104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:52.449448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ac62f8ef-be00-443e-bf67-b987c898f7db tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.155523 Sep 09 21:13:52.450059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 382/765] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:52 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:53.472801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:53.473504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:53.480597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:53.481079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:53.481539 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:53.482225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:53.482676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:53.483098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:53.622148 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:53.630204 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d5771e20-9e0a-425d-aeef-edb5a46abedc tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.161703 Sep 09 21:13:53.630760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 384/766] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:53 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:54.653684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:54.654324 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:54.660723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:54.661204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:54.661668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:54.662388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:54.662839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:54.663258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:54.790165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:54.798268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fd27a516-02a8-49d7-b00d-6b4245a00a52 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.148700 Sep 09 21:13:54.798839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 383/767] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:54 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:55.820806 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:55.821410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:55.827802 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:55.828267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:55.828700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:55.829657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:55.830110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:55.830526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:55.960224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:55.967739 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9775c23d-88bc-44b7-9082-ddbcc4cd8377 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.150764 Sep 09 21:13:55.968335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 385/768] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:55 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:13:56.990154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:56.990763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:56.997117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:56.997592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:56.998024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:56.998704 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:56.999152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:56.999597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:57.133014 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:57.140673 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-25f4411e-8440-43c9-ae6c-543f2a161e4c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.154443 Sep 09 21:13:57.141240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 384/769] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:56 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:58.164590 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:58.165203 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:58.171510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:58.171988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:58.172472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:58.173212 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:58.173620 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:58.174034 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:58.311022 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:58.318750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f0bfc01e-0287-40f7-b0b0-e1f0e33edb3e tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1362 microversion: 2.1 time: 0.158541 Sep 09 21:13:58.319321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 386/770] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:58 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:59.342164 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:59.343078 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:59.349082 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:59.350219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:59.350664 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:59.351373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:59.351836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:59.352294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:59.485613 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:13:59.493617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-45d56514-f4fc-4cf2-8615-bc006cca2759 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1548 microversion: 2.1 time: 0.155480 Sep 09 21:13:59.494196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 385/771] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:13:59 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:13:59.517917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:13:59.518434 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:13:59.525330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:59.528512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:59.528512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:59.528512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:13:59.528512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:13:59.528908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:13:59.604242 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ccd3fdd3-f726-430f-bee5-d07074530416 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090139 Sep 09 21:13:59.605006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 387/772] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:13:59 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:14:00.587419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-53431820-fa23-4664-a91a-2992121eea13 req-81c05e5a-7238-4cee-bfb9-88733bc33b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af5f313-0ae0-4c98-8823-c398127b8fd1", "tag": "0e3cc85d-c58f-404a-a9e9-c823c8cd640b"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:14:00.598689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-53431820-fa23-4664-a91a-2992121eea13 req-81c05e5a-7238-4cee-bfb9-88733bc33b62 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:00.599749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-53431820-fa23-4664-a91a-2992121eea13 req-81c05e5a-7238-4cee-bfb9-88733bc33b62 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:00.600207 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-53431820-fa23-4664-a91a-2992121eea13 req-81c05e5a-7238-4cee-bfb9-88733bc33b62 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:00.611787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-53431820-fa23-4664-a91a-2992121eea13 req-81c05e5a-7238-4cee-bfb9-88733bc33b62 service nova] Creating event network-changed:0e3cc85d-c58f-404a-a9e9-c823c8cd640b for instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 on hv-cinder-83124 Sep 09 21:14:00.617119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-53431820-fa23-4664-a91a-2992121eea13 req-81c05e5a-7238-4cee-bfb9-88733bc33b62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034010 Sep 09 21:14:00.625639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 386/773] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:14:21.205133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:21.205897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=84 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:21.210159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:21.210658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:21.216420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:21.216908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:21.217341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:21.218044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:21.218498 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:21.218923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:21.243064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4ecb69ce-2874-497b-a4d2-476d13f2dba9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/ips" status: 200 len: 152 microversion: 2.20 time: 0.040152 Sep 09 21:14:21.243635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 388/774] 10.222.0.48 () {60 vars in 1289 bytes} [Fri Sep 9 21:14:21 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:14:23.242659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:14:23.243390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Fri Sep 9 21:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/action (ip 10.222.0.48) !!! Sep 09 21:14:23.243901 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:23.244854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:23.249465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:14:23.250079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:23.258196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:23.258905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:23.259526 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:23.260719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:23.261330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:23.261911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:23.287694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lazy-loading 'flavor' on Instance uuid c43ab2f3-86c6-4173-8480-56fbe0061814 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:14:23.685191 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9b12685d-e550-4d4e-a646-d5820fcf7626 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/action" status: 202 len: 0 microversion: 2.20 time: 0.444100 Sep 09 21:14:23.685787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 387/775] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Sep 9 21:14:23 2022] POST /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:14:23.693978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:23.694589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:23.713872 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:23.714368 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:23.715118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:23.715841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:23.716344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:23.716772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:23.847734 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:23.856353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:23.857787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:23.859017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1efaf785-8308-426d-9ff8-70372d7872dc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.168968 Sep 09 21:14:23.859575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 389/776] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:23 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:24.885962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:24.886698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:24.893184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:24.893687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:24.894112 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:24.894843 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:24.895297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:24.895730 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:25.047396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:25.056007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:25.057521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:25.058782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2d1d6444-c006-4228-b2f2-1fa11d7e63cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.177464 Sep 09 21:14:25.059231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 388/777] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:24 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:26.083396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:26.084051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:26.090894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:26.091370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:26.091828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:26.092534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:26.092982 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:26.096250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:26.222623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:26.230894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:26.232490 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:26.233677 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2e0f6b34-f2af-4255-b73d-a412cbc7ce17 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.154509 Sep 09 21:14:26.234528 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 390/778] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:26 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:27.261911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:27.269473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:27.269473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:27.269473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:27.269904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:27.270259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:27.270717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:27.271154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:27.404094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:27.412104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:27.413565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:27.414739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-326797fc-a050-4c9c-96c3-439425839893 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.157463 Sep 09 21:14:27.415407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 389/779] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:27 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:28.439354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:28.439957 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:28.447013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:28.449327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:28.449327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:28.449327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:28.449327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:28.449705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:28.578942 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:28.587236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:28.588711 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:28.589860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-42536033-d686-496e-a4c0-ebc512c2ee88 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.154437 Sep 09 21:14:28.590404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 391/780] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:28 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:29.615805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:29.616390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:29.622860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:29.623344 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:29.623778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:29.624502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:29.624950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:29.625373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:29.763287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:29.772580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:29.774106 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:29.775291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4e0ebf53-7238-4c66-9904-87dc87851623 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.163563 Sep 09 21:14:29.775853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 390/781] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:29 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:30.800588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:30.801198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:30.807834 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:30.808339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:30.808767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:30.809447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:30.809891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:30.810301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:30.942956 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:30.951749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:30.953240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:30.954831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-59119dc6-ea8c-4141-8bba-1f8a4d61a1db tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.157833 Sep 09 21:14:30.955389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 392/782] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:30 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:31.981407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:31.982037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:31.988490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:31.988970 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:31.989402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:31.990095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:31.990541 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:31.990959 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:32.122607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:32.130624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:32.132876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:32.134096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e79fb4b5-c267-4c44-b6da-28fe23caa452 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.156564 Sep 09 21:14:32.134652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 391/783] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:31 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:33.159773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:33.160408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:33.167606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:33.168115 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:33.168556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:33.169260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:33.169712 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:33.170135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:33.308508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:33.316717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:33.318162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:33.319344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-85659f86-9e3f-46db-a9c4-1bb188472ec4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.163704 Sep 09 21:14:33.319899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 393/784] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:33 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:34.345897 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:34.346508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:34.353663 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:34.354139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:34.354569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:34.355286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:34.355734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:34.356241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:34.487506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:34.495745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:34.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:34.498468 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c3282614-3e6c-4d83-9f4d-5a3200d8328c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.156959 Sep 09 21:14:34.499225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 392/785] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:34 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:35.524578 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:35.525187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:35.531486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:35.531970 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:35.532436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:35.533169 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:35.533585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:35.534004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:35.669126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:35.677409 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:35.678865 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:35.680801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9ab833b9-35eb-4361-8bc3-d81b30d72762 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.159995 Sep 09 21:14:35.681400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 394/786] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:35 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:36.708355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:36.708964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:36.715863 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:36.716372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:36.716807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:36.717489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:36.717937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:36.718626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:36.852173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:36.860405 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:36.861894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:36.863061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5651defd-506f-4953-bb8b-05a3dc4b6400 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.159019 Sep 09 21:14:36.863619 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 393/787] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:36 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:37.869909 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-55905259-1337-4104-9e5b-1ac2d2f46661 req-870935c8-93c7-4c15-ad5c-9ece0130b32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "name": "network-vif-plugged", "status": "completed", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:14:37.879928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-55905259-1337-4104-9e5b-1ac2d2f46661 req-870935c8-93c7-4c15-ad5c-9ece0130b32a service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:37.880432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-55905259-1337-4104-9e5b-1ac2d2f46661 req-870935c8-93c7-4c15-ad5c-9ece0130b32a service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:37.880852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-55905259-1337-4104-9e5b-1ac2d2f46661 req-870935c8-93c7-4c15-ad5c-9ece0130b32a service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:37.893014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-55905259-1337-4104-9e5b-1ac2d2f46661 req-870935c8-93c7-4c15-ad5c-9ece0130b32a service nova] Creating event network-vif-plugged:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:14:37.895535 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:37.897031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:37.898674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-55905259-1337-4104-9e5b-1ac2d2f46661 req-870935c8-93c7-4c15-ad5c-9ece0130b32a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031967 Sep 09 21:14:37.899261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 395/788] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:14:37.902960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:37.903445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:37.903882 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:37.904606 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:37.905063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:37.905488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:38.034232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:38.042341 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:38.043846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:38.045029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3d0da437-27a7-4fce-834e-4a1b1690fec7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.158812 Sep 09 21:14:38.045605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 394/789] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:37 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:39.071502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:39.072225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:39.078250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:39.078726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:39.079158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:39.080116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:39.080571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:39.080996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:39.208023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:39.218473 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:39.220257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:39.221213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5334ce2b-56ed-4a0f-a45b-263b8b3ae192 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.154934 Sep 09 21:14:39.221764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 396/790] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:39 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:40.246997 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:40.247527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:40.253898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:40.254379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:40.254812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:40.255498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:40.255949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:40.256389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:40.383519 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:40.391478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:40.392959 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:40.394107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-20b257ca-c305-4ac1-a170-49f482a52cb8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.151142 Sep 09 21:14:40.394654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 395/791] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:40 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:41.420666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:41.421410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:41.427813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:41.428328 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:41.428769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:41.430079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:41.430539 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:41.430990 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:41.559147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:41.567243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:41.568731 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:41.569894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-817a04d6-f201-48ef-aa77-3709841d7901 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.153298 Sep 09 21:14:41.570443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 397/792] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:41 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:42.595379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:42.596005 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:42.602380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:42.602855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:42.603293 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:42.603978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:42.604451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:42.604874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:42.728167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:42.736266 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:42.737719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:42.738872 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-33d8bacb-378c-43c1-8322-9cd2a64bf573 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.147417 Sep 09 21:14:42.739431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 396/793] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:42 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:14:43.764233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:43.764826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:43.771325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:43.771827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:43.772316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:43.773656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:43.774106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:43.774517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:43.900766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:43.908636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:43.910061 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:43.911198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bc4ce9c8-3291-4023-a873-e9928494914f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1743 microversion: 2.20 time: 0.150916 Sep 09 21:14:43.911749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 398/794] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:43 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:44.937222 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:44.937916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:44.944478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:44.944963 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:44.945434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:44.946126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:44.946581 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:44.947006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:45.082415 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:45.092421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:45.095625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:45.096845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-df3dfad2-1810-4980-a895-61b5d1630121 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.163542 Sep 09 21:14:45.097412 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 397/795] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:44 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:46.122116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:46.123088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:46.129043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:46.129524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:46.129958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:46.130658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:46.131109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:46.131649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:46.268105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:46.275789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:46.277060 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:46.278230 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-50019727-f5d8-454a-abf8-77d5fd7c7db5 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.159982 Sep 09 21:14:46.289500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 399/796] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:46 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:47.304991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:47.307506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:47.317129 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:47.317699 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:47.318138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:47.318846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:47.319296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:47.319715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:47.465224 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:47.474123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:47.475542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:47.476883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5d013f5a-175d-4db3-9427-d13cdee61b72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.176698 Sep 09 21:14:47.477943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 398/797] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:47 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:48.502852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:48.504119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:48.511719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:48.512275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:48.512714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:48.513413 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:48.513870 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:48.514296 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:48.668587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:48.684297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:48.685844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:48.697040 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fb0a0a7f-80fc-4e69-a204-d5c114903a12 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.188324 Sep 09 21:14:48.697040 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 400/798] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:48 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:49.715973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:49.716762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:49.723352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:49.724099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:49.724723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:49.725489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:49.725933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:49.726530 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:49.867379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:49.876672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:49.878380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:49.879625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7cfd0965-24d0-4d4a-951f-13ccc4179af9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.168435 Sep 09 21:14:49.880200 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 399/799] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:49 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:50.906624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:50.908611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:50.915831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:50.916873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:50.917301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:50.918187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:50.918632 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:50.919232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:51.077751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:51.094753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:51.096427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:51.099165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6fe5f83b-8a88-44ad-8100-afcbd985cc74 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.197347 Sep 09 21:14:51.100134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 401/800] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:50 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:52.129975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:52.130623 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:52.137702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:52.142881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:52.142881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:52.142881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:52.142881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:52.143230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:52.274814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:52.283759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:52.285244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:52.286399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5ae93f47-f538-4b51-ad67-6f9b9814ce72 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.160403 Sep 09 21:14:52.286951 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 400/801] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:52 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:53.314081 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:53.314736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:53.323641 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:53.324440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:53.325981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:53.327297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:53.328415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:53.329146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:53.540455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:53.550616 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:53.552362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:53.553540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b815bca0-57c8-48ed-aef0-98335f7fe355 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.244030 Sep 09 21:14:53.554283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 402/802] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:53 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:54.582373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:54.582996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:54.585029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=29 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:54.590083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:54.590578 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:54.591021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:54.591719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:54.592203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:54.592630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:54.596793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:54.947978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:54.956582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:54.958051 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:54.959232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-192ab8b5-1564-4984-b3ce-3366817b937b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.381330 Sep 09 21:14:54.959796 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 401/803] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:54 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:55.986927 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:55.987913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:56.001643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:56.002138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:56.002575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:56.007018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:56.007514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:56.008186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:56.019706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=85 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:56.197601 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:56.209382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:56.211489 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:56.214500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bccd3f5d-1af3-44b2-aa70-570653644587 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.231816 Sep 09 21:14:56.215707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 403/804] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:55 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:57.148410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:57.148953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:57.156026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-efa2dac4-ecc7-4716-b899-a3a3e081d30b req-06750afb-38ba-4aa4-9606-778109ae9a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:14:57.178658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=33 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:14:57.180950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.181468 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.181929 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.183231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.183695 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.184151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.186851 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-efa2dac4-ecc7-4716-b899-a3a3e081d30b req-06750afb-38ba-4aa4-9606-778109ae9a37 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.187328 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-efa2dac4-ecc7-4716-b899-a3a3e081d30b req-06750afb-38ba-4aa4-9606-778109ae9a37 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.187757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-efa2dac4-ecc7-4716-b899-a3a3e081d30b req-06750afb-38ba-4aa4-9606-778109ae9a37 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.224778 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-efa2dac4-ecc7-4716-b899-a3a3e081d30b req-06750afb-38ba-4aa4-9606-778109ae9a37 service nova] Creating event network-changed:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:14:57.241250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-efa2dac4-ecc7-4716-b899-a3a3e081d30b req-06750afb-38ba-4aa4-9606-778109ae9a37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088754 Sep 09 21:14:57.242437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 404/805] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:14:57.251565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:57.253855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:57.257488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:14:57.261770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.262715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.263391 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.264362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.265651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.266299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.487965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:57.498515 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:57.501941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:57.503297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-335922c9-8a96-4bac-a109-308c443ec77e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.259348 Sep 09 21:14:57.505402 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 405/806] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:57 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:57.637863 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d8e014ff-a98a-4fdf-a6ac-28a6736c9771 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 204 len: 0 microversion: 2.1 time: 0.493112 Sep 09 21:14:57.640191 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 402/807] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:14:57 2022] DELETE /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:14:57.646997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:57.647604 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:57.658481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.659053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.659716 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.660700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:57.661285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:57.661778 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:57.830609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:57.841384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d3507bda-a935-4e47-8dcb-cde579dd0885 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.198376 Sep 09 21:14:57.856098 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 406/808] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:14:57 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:14:58.534226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:58.535034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:58.543514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:58.544567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:58.545530 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:58.546905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:58.547575 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:58.548085 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:58.753425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:58.764009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:58.765834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:58.767127 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-945f6d8a-3ddf-486f-af8b-95a88dd91a0a tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.237175 Sep 09 21:14:58.767955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 403/809] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:58 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:14:58.865598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:58.870344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:58.874035 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:58.874829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:58.875507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:58.876282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:58.876904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:58.877324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:59.034049 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:59.042526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-62e6a030-bda0-415b-80e6-db31335bb154 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1569 microversion: 2.1 time: 0.180537 Sep 09 21:14:59.044549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 407/810] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:14:58 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:14:59.793175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:14:59.793752 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:14:59.801761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:59.802243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:59.802681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:59.803380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:14:59.803829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:14:59.804280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:14:59.929003 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:59.936963 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:59.938404 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:14:59.939557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b2b7ba4a-0e61-4d01-9ef3-6dc066b3ab3c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.150332 Sep 09 21:14:59.940133 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 404/811] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:14:59 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:00.068375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:00.073737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:00.075689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:00.076193 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:00.076624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:00.077301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:00.077746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:00.078160 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:00.218721 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:00.226434 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b443cb29-3433-48b4-bfb3-4c87ee5f231b tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1450 microversion: 2.1 time: 0.161882 Sep 09 21:15:00.226993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 408/812] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:00 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:00.965524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:00.966141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:00.972594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:00.973071 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:00.973505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:00.974197 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:00.974648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:00.975072 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:01.100896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:01.113637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:01.115086 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:01.116288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7dae7062-32a2-48d5-aad0-9e360a584334 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.154642 Sep 09 21:15:01.116848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 405/813] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:00 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:01.249118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:01.249642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:01.256032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:01.256544 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:01.256979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:01.257670 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:01.258124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:01.258555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:01.396493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:01.404758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4d9632e7-5c5c-4863-a3cd-dc580298ab25 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1450 microversion: 2.1 time: 0.159665 Sep 09 21:15:01.405314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 409/814] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:01 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:02.145491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:02.146024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:02.152414 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:02.152889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:02.153326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:02.154119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:02.154570 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:02.154987 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:02.280703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:02.287740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:02.289212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:02.290353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-87b74570-444b-4850-94e3-7f0e99e33d0c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.148873 Sep 09 21:15:02.290903 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 406/815] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:02 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:02.427668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:02.428315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:02.435194 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:02.438152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:02.438152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:02.438152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:02.438152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:02.438513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:02.563250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:02.570993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f142d7a3-73e9-4522-ab09-87431a5c66df tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1450 microversion: 2.1 time: 0.147230 Sep 09 21:15:02.571559 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 410/816] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:02 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:03.316740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:03.317284 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:03.324201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:03.324687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:03.325122 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:03.325807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:03.326257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:03.326681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:03.458435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:03.470033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:03.472338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:03.473577 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2cf2f7b5-dcb9-4b69-9262-e5f15f84f72d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1738 microversion: 2.20 time: 0.160901 Sep 09 21:15:03.474835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 407/817] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:03 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:03.593918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:03.594464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:03.601715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:03.602199 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:03.602631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:03.603324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:03.603777 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:03.604229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:03.756062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:03.764545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0d6a0b44-c4bd-48e4-8ba6-3715f43cc30a tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1450 microversion: 2.1 time: 0.174565 Sep 09 21:15:03.765117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 411/818] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:03 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:03.783908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-165bfdf1-675b-4b8c-ade4-e66b0b8db851 req-7e3b4c12-c748-4923-921d-ef38644c38a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "name": "network-vif-unplugged", "status": "completed", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:03.795081 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-165bfdf1-675b-4b8c-ade4-e66b0b8db851 req-7e3b4c12-c748-4923-921d-ef38644c38a5 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:03.795563 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-165bfdf1-675b-4b8c-ade4-e66b0b8db851 req-7e3b4c12-c748-4923-921d-ef38644c38a5 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:03.796027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-165bfdf1-675b-4b8c-ade4-e66b0b8db851 req-7e3b4c12-c748-4923-921d-ef38644c38a5 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:03.807173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-165bfdf1-675b-4b8c-ade4-e66b0b8db851 req-7e3b4c12-c748-4923-921d-ef38644c38a5 service nova] Creating event network-vif-unplugged:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:15:03.812873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-165bfdf1-675b-4b8c-ade4-e66b0b8db851 req-7e3b4c12-c748-4923-921d-ef38644c38a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032726 Sep 09 21:15:03.813475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 408/819] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:04.160667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-f5397acb-233b-4723-9c68-ecec2c10cc13 req-7c619506-f2ec-4c53-b74e-38e67da477f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b6c6972-1eb9-4a42-ab0f-aa924936f83d", "name": "network-vif-deleted", "tag": "302ac7d3-9f25-47d5-9b48-164bd19c6809"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:04.170644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f5397acb-233b-4723-9c68-ecec2c10cc13 req-7c619506-f2ec-4c53-b74e-38e67da477f1 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:04.171128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f5397acb-233b-4723-9c68-ecec2c10cc13 req-7c619506-f2ec-4c53-b74e-38e67da477f1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:04.171560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f5397acb-233b-4723-9c68-ecec2c10cc13 req-7c619506-f2ec-4c53-b74e-38e67da477f1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:04.183008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-f5397acb-233b-4723-9c68-ecec2c10cc13 req-7c619506-f2ec-4c53-b74e-38e67da477f1 service nova] Creating event network-vif-deleted:302ac7d3-9f25-47d5-9b48-164bd19c6809 for instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d on hv-cinder-83124 Sep 09 21:15:04.188196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-f5397acb-233b-4723-9c68-ecec2c10cc13 req-7c619506-f2ec-4c53-b74e-38e67da477f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031091 Sep 09 21:15:04.188772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 412/820] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:04.501026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:04.501739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:04.508198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:04.508691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:04.509133 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:04.509962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:04.510927 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:04.511358 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:04.648484 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:04.658361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:04.659886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:04.661152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7209e61b-6f0f-48b8-b06e-fc216d9412d7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1720 microversion: 2.20 time: 0.165077 Sep 09 21:15:04.662077 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 409/821] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:04 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:15:04.787889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:04.788668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:04.794692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:04.795171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:04.795599 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:04.796309 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:04.796756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:04.797178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:04.858225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:04.866107 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-add1bd65-9810-4c6c-b95c-2e045521010d tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1219 microversion: 2.1 time: 0.083033 Sep 09 21:15:04.866672 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 413/822] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:04 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:05.687272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:05.687907 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:05.694373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:05.694847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:05.695277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:05.695957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:05.696611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:05.697040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:05.824124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:05.832488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:05.833923 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:05.835062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-977a2a56-8991-4246-9c1e-4d5e4a8f79da tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1720 microversion: 2.20 time: 0.151655 Sep 09 21:15:05.835616 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 410/823] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:05 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:05.890207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:05.890823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:05.897092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:05.897568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:05.898000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:05.898690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:05.899140 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:05.899579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:05.963701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:05.971306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-dfd1d2cf-c229-4223-8699-b1094098a97e tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1219 microversion: 2.1 time: 0.085659 Sep 09 21:15:05.971858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 414/824] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:05 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:06.859325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:06.859942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:06.866232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:06.866710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:06.867147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:06.867830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:06.868315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:06.868734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:06.993658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:06.994280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:06.994481 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:07.000864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:07.001469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:07.001904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:07.002601 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:07.002709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:07.003058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:07.003482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:07.004118 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:07.005271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fc53bfe9-2bf3-44df-a77a-1bf591bb9b37 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1720 microversion: 2.20 time: 0.149871 Sep 09 21:15:07.005831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 411/825] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:06 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:07.064571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:07.072205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6868bd70-183d-4a83-8fd3-0678cb119d56 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1219 microversion: 2.1 time: 0.082352 Sep 09 21:15:07.073399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 415/826] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:06 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:08.031218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:08.031824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:08.038169 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:08.038645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:08.039075 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:08.039754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:08.040240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:08.040657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:08.095562 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:08.096215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:08.104979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:08.105472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:08.105915 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:08.106621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:08.107076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:08.107501 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:08.173813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:08.181426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f1261c81-161f-4a75-a773-a0ba739f058c tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1219 microversion: 2.1 time: 0.089785 Sep 09 21:15:08.181997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 416/827] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:08 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:08.194530 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:08.203023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:08.204493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:08.205923 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f2efd56a-5001-49bd-bedc-0e4410ac90b6 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1720 microversion: 2.20 time: 0.178592 Sep 09 21:15:08.206465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 412/828] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:08 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:09.189430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-3b2cbf6a-2653-430c-9324-d30a6f92d56b req-a7cc7907-8a70-41e9-9dcd-fe99dc8aa81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "name": "network-vif-unplugged", "status": "completed", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:09.199184 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-3b2cbf6a-2653-430c-9324-d30a6f92d56b req-a7cc7907-8a70-41e9-9dcd-fe99dc8aa81b service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:09.199688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-3b2cbf6a-2653-430c-9324-d30a6f92d56b req-a7cc7907-8a70-41e9-9dcd-fe99dc8aa81b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:09.200141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-3b2cbf6a-2653-430c-9324-d30a6f92d56b req-a7cc7907-8a70-41e9-9dcd-fe99dc8aa81b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:09.204171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:09.205185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:09.212203 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-3b2cbf6a-2653-430c-9324-d30a6f92d56b req-a7cc7907-8a70-41e9-9dcd-fe99dc8aa81b service nova] Creating event network-vif-unplugged:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:15:09.212400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:09.212400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:09.212400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:09.213010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:09.213505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:09.213932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:09.216153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-3b2cbf6a-2653-430c-9324-d30a6f92d56b req-a7cc7907-8a70-41e9-9dcd-fe99dc8aa81b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030412 Sep 09 21:15:09.216736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 417/829] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:09.231482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:09.232190 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:09.238147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:09.238640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:09.239078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:09.239769 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:09.240262 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:09.240687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:09.280172 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:09.286940 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-906c053c-7b24-4914-976c-437769b94ab7 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1219 microversion: 2.1 time: 0.086765 Sep 09 21:15:09.287530 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 413/830] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:09 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:09.379105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:09.387214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:09.388749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:09.389902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b9e3c88b-aca0-4eab-b817-6945c223d427 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1720 microversion: 2.20 time: 0.163035 Sep 09 21:15:09.390453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 418/831] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:09 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:15:10.309830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:10.310445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:10.316877 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:10.317362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:10.317802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:10.318497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:10.318979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:10.319406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:10.381922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:10.390643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2612fd5e-dd76-44c0-ba42-bc51a9090108 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1219 microversion: 2.1 time: 0.085217 Sep 09 21:15:10.391221 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 414/832] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:10 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:10.415406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:10.416014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:10.422880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:10.423360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:10.423798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:10.424517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:10.424969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:10.425394 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:10.553084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:10.562886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:10.563347 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:10.564526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3a5b0843-64f1-4a2d-a46e-a83951d2b03b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1720 microversion: 2.20 time: 0.152997 Sep 09 21:15:10.565069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 419/833] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:10 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:11.413425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:11.414047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:11.421061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.421558 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.421995 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.422691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.423228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.423784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.455162 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.455649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.456099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.456617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lazy-loading 'fault' on Instance uuid 1b6c6972-1eb9-4a42-ab0f-aa924936f83d {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:15:11.496834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17adcb2be25427485d5004c7821e094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26a3ee560e449b8b1188b9defa98fa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:11.504512 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fe17793b-29d7-4a33-8a83-80a6d1f07106 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 200 len: 1224 microversion: 2.1 time: 0.095052 Sep 09 21:15:11.505020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 415/834] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:11 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:11.590158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:11.590756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:11.597171 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.597643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.598070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.598745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.599188 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.599604 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.733755 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:11.741865 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:11.743312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:11.744494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-401b705a-14d4-4f06-b619-b0cb0b885621 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1723 microversion: 2.20 time: 0.158247 Sep 09 21:15:11.745057 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 420/835] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:11 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:11.771336 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a4c87a-65a4-4be5-b9c9-b15530ce73d9"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:11.774158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:11.781705 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.782249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.782692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.783388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:11.783836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:11.784303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:11.800624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:12.528438 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:12.529207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] [instance: 1b6c6972-1eb9-4a42-ab0f-aa924936f83d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:12.535511 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:12.536045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:12.536504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:12.537213 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:12.537738 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:12.538206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:12.554913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] HTTP exception thrown: Instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d could not be found. Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Request method failure captured: Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d HTTP/1.1 Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6rVUpvtL32cy9yBTO5cLH_B5-Ihu774ZDzGHat4_lvSHGS34aPQRKGjoMnTPbqge6LleZ6WePZkmyMFVMkahsAP2s6kfY6mzFFknQPKph1V0lwc_IwVCqrvgGLid3QwRSCU-KREgUhOM4T037OEqQtlGnmmwBunbXU5mlxgaIw3ndk Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: d26a3ee560e449b8b1188b9defa98fa6 Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-TestShelveInstance-393989724 Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:15:12.556574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d26a3ee560e449b8b1188b9defa98fa6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d26a3ee560e449b8b1188b9defa98fa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d26a3ee560e449b8b1188b9defa98fa6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d26a3ee560e449b8b1188b9defa98fa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-TestShelveInstance-393989724 Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: d26a3ee560e449b8b1188b9defa98fa6 Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-TestShelveInstance-393989724 Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-TestShelveInstance-393989724-project Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: b17adcb2be25427485d5004c7821e094 Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-TestShelveInstance-393989724-project Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d could not be found. Sep 09 21:15:12.558322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '1b6c6972-1eb9-4a42-ab0f-aa924936f83d'} Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d could not be found. Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:15:12.559360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d could not be found. Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d could not be found. Sep 09 21:15:12.560947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:12.562328 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Returning 404 to user: Instance 1b6c6972-1eb9-4a42-ab0f-aa924936f83d could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:15:12.562328 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-13985157-1d0d-4e8c-a394-1398e4b60223 tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d" status: 404 len: 111 microversion: 2.1 time: 0.034281 Sep 09 21:15:12.562328 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 421/836] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:12 2022] GET /compute/v2.1/servers/1b6c6972-1eb9-4a42-ab0f-aa924936f83d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:15:12.762742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6a7ae934-89ba-4a39-ba33-8663d1b14052 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.995503 Sep 09 21:15:12.763625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 416/837] 10.222.0.48 () {62 vars in 1364 bytes} [Fri Sep 9 21:15:11 2022] POST /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-volume_attachments => generated 188 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 21:15:12.773947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-31105384-4feb-4fd7-be7f-437007a98bff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] Calling method '.version_select at 0x7fa1d0803820>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:12.848930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-31105384-4feb-4fd7-be7f-437007a98bff tempest-TestShelveInstance-393989724 tempest-TestShelveInstance-393989724-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1420081761" status: 202 len: 0 microversion: 2.1 time: 0.078791 Sep 09 21:15:12.849536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 422/838] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Sep 9 21:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1420081761 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:15:12.895738 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:12.896275 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:12.902791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:12.903313 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:12.903756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:12.904484 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:12.904943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:12.905398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:13.577542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b8ba9772-7dcb-472f-97e3-79df9fe54cfa tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-volume_attachments/d9a4c87a-65a4-4be5-b9c9-b15530ce73d9" status: 202 len: 0 microversion: 2.20 time: 0.677840 Sep 09 21:15:13.577542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 417/839] 10.222.0.48 () {60 vars in 1457 bytes} [Fri Sep 9 21:15:12 2022] DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-volume_attachments/d9a4c87a-65a4-4be5-b9c9-b15530ce73d9 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:15:13.655159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:13.655770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:13.662530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:13.663256 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:13.663854 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:13.669384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:13.669384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:13.669384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:13.679435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:13.696699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121137) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 21:15:13.929835 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR oslo.messaging._drivers.impl_rabbit [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [1d2ab142-cedb-413a-9760-fea778afe98c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:15:14.938246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO oslo.messaging._drivers.impl_rabbit [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [1d2ab142-cedb-413a-9760-fea778afe98c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 51010. Sep 09 21:15:14.941764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-343878cd-ebf8-4499-b50e-b1b0b5666258 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "POST /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/action" status: 202 len: 0 microversion: 2.20 time: 1.291088 Sep 09 21:15:14.942596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 423/840] 10.222.0.48 () {62 vars in 1319 bytes} [Fri Sep 9 21:15:13 2022] POST /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/action => generated 0 bytes in 1293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:15:14.952119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:14.952733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:14.966694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:14.969980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:14.970856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:14.972656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:14.973129 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:14.976246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:15.228759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:15.241240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:15.243992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:15.245369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-70cc9e62-e74b-4bac-a8f7-ab354d7a5d30 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1671 microversion: 2.20 time: 0.298255 Sep 09 21:15:15.262734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 418/841] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:14 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1671 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:16.276105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:16.276725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:16.284458 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:16.285232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:16.285675 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:16.286498 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:16.287183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:16.287618 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:16.483154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:16.491554 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:16.493107 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:16.494267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-436cde0e-460c-4b35-aade-f323f0faddbd tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1671 microversion: 2.20 time: 0.222702 Sep 09 21:15:16.504321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 424/842] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:16 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1671 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:17.522459 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:17.523069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:17.530163 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:17.530640 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:17.531074 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:17.531762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:17.532236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:17.532654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:17.742615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:17.750791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:17.752491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:17.753711 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7bd09263-642d-4e1a-8578-834c136de2ae tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1671 microversion: 2.20 time: 0.235439 Sep 09 21:15:17.754549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 419/843] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:17 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:18.778958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:18.780319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:18.787326 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:18.787911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:18.788449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:18.789258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:18.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:18.790275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:19.004951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:19.013270 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:19.015928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:19.015928 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6439cafb-c4a4-4ad5-a653-04274dc1b94c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1671 microversion: 2.20 time: 0.240896 Sep 09 21:15:19.016824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 425/844] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:18 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:20.041042 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:20.042940 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:20.049779 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:20.050494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:20.051152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:20.052001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:20.053018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:20.053601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:20.341469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:20.350946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:20.352558 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:20.353991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1554e6ed-c71c-462c-af84-f6a4f17210bb tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.316660 Sep 09 21:15:20.354630 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 420/845] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:20 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:21.388031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:21.388676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:21.395152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:21.395656 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:21.396117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:21.396812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:21.397265 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:21.397690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:21.537236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:21.547561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:21.549315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:21.552725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4ddadb34-53fc-4df9-9be0-b28f8d9d0e4f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.167530 Sep 09 21:15:21.552725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 426/846] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:21 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:22.584837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:22.585592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:22.592888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:22.593396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:22.594082 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:22.594698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:22.595177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:22.595624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:22.748488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:22.759701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:22.759701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:22.760865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4e75b40c-a0e3-41df-a911-fb03677332d8 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.182074 Sep 09 21:15:22.763892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 421/847] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:22 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:23.789731 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:23.790307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:23.797619 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:23.798102 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:23.798536 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:23.799236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:23.799687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:23.800133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:23.966411 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:23.977981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:23.989972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:23.989972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-60ab9dde-70b3-4744-92df-22c365957dc0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.195585 Sep 09 21:15:23.989972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 427/848] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:23 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:25.012896 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:25.014659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:25.017433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:25.022433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:25.022928 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:25.023425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:25.024326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:25.024958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:25.025638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:25.170094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:25.178534 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:25.179989 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:25.181237 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c63420f9-0a58-472c-aafc-b9ef8e5f73a0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.177760 Sep 09 21:15:25.181731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 422/849] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:25 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:26.205822 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:26.206403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:26.212874 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:26.213355 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:26.213791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:26.214488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:26.214937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:26.215392 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:26.379418 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:26.388132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:26.389592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:26.390764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f043c458-2e64-47a2-aac0-100af8f604f0 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.189064 Sep 09 21:15:26.391315 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 428/850] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:26 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:27.419735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:27.420733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:27.430282 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:27.431122 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:27.431793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:27.433190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:27.434533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:27.435218 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:27.767372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:27.777361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:27.779531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:27.780981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-46640004-1aab-4973-b0e7-0117ecb71d7d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.365952 Sep 09 21:15:27.781540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 423/851] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:27 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:28.815930 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:28.816699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:28.819145 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:28.823931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:28.824481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:28.824957 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:28.825810 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:28.826373 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:28.826848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:28.979989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:28.989143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:28.990624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:28.992030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d1df2a5f-3a5f-494e-9880-bb376fd9864c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.180544 Sep 09 21:15:28.992650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 429/852] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:28 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:30.018159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:30.018851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:30.025582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:30.026178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:30.026685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:30.027444 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:30.028106 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:30.028679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:30.183024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:30.195142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:30.198102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:30.198102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ab4efc07-3a00-4ed3-872a-ec9153ccd657 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.183656 Sep 09 21:15:30.205775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 424/853] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:30 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:31.223687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:31.224341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:31.231048 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:31.234284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:31.234284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:31.234284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:31.234284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:31.234654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:31.364946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:31.373958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:31.375411 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:31.376610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0846600b-22ea-4540-bf4d-cc5848926919 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.157065 Sep 09 21:15:31.377164 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 430/854] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:31 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:32.403451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:32.404050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:32.410402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:32.410887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:32.411326 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:32.412013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:32.412493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:32.412917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:32.542553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:32.550848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:32.552391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:32.553556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a2bfd29d-821b-4cea-9465-6abcca3eafb3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.154680 Sep 09 21:15:32.554107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 425/855] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:32 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:33.579177 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:33.579790 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:33.586639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:33.587121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:33.587555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:33.588279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:33.588735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:33.589158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:33.716476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:33.724455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:33.725891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:33.727044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0f919f87-79a2-442d-9a17-2ffe3621253b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.152178 Sep 09 21:15:33.727604 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 431/856] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:33 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:33.923487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-226235459", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "networks": [{"uuid": "db21fc85-6727-4510-ba40-41044bcdfd71"}]}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:33.976625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] validate_networks() for [('db21fc85-6727-4510-ba40-41044bcdfd71', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:15:34.312379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:15:34.312825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:15:34.313297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:15:34.313704 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:15:34.314116 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:15:34.322740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:34.323215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:34.323637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:34.325018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:34.325466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:34.325883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:34.341958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Getting quotas for project 684ee48934f949499a7c77d782372b53. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:15:34.346054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Getting quotas for user 3ce5a94e8c594b8d813ab8e6d39633af and project 684ee48934f949499a7c77d782372b53. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:15:34.358709 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:15:34.361050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:15:34.507399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e187dfb7-99f3-4f2d-a658-9aab417325e9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587676 Sep 09 21:15:34.508038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 426/857] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:15:34.518954 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-da0fe568-2ce1-4ef2-b0ed-7b13f50d8115 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:34.519559 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-da0fe568-2ce1-4ef2-b0ed-7b13f50d8115 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:34.571146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-da0fe568-2ce1-4ef2-b0ed-7b13f50d8115 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:34.578679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-da0fe568-2ce1-4ef2-b0ed-7b13f50d8115 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1213 microversion: 2.1 time: 0.063483 Sep 09 21:15:34.579243 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 432/858] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:34 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:34.954435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:34.955324 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:34.962092 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:34.962387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:34.962819 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:34.963510 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:34.963965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:34.964419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:35.094909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:35.102941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:35.104417 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:35.106121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0dd60f3f-8ae5-47e3-8d19-71e5c00d066d tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.356513 Sep 09 21:15:35.106674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 427/859] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:34 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:35.601911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:35.613225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:35.613225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:35.613225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:35.613225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:35.613636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:35.613636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:35.613636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:35.682719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:35.686586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5173f689-3306-409a-b06f-750822acbcaa tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1217 microversion: 2.1 time: 0.088646 Sep 09 21:15:35.687158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 433/860] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:35 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:36.131826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:36.132411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:36.138941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:36.139413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:36.139838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:36.140556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:36.141005 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:36.141424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:36.159112 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:36.279513 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:36.295552 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:36.295552 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:36.295552 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7c851186-8388-426e-ac2b-ec159675e7cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.163200 Sep 09 21:15:36.295829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 428/861] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:36 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:36.710061 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:36.710649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:36.717468 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:36.717952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:36.718403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:36.719077 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:36.719532 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:36.719950 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:36.783036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:36.790660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2106bb4e-4237-48c2-a7e4-ea02e585f622 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1265 microversion: 2.1 time: 0.084544 Sep 09 21:15:36.791220 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 434/862] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:36 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:37.317229 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:37.317935 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:37.325076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:37.325636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:37.333319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:37.337604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:37.337604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:37.337604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:37.471323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:37.479478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:37.480915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:37.482088 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-03eb092f-c476-4948-b61d-02592ae06ce7 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.168817 Sep 09 21:15:37.482646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 429/863] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:37 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:37.814114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:37.814741 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:37.821051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:37.821543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:37.821983 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:37.822766 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:37.823570 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:37.824368 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:37.963478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:37.971440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e72c2da9-2677-4206-bb31-ee3ada28ad94 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.161141 Sep 09 21:15:37.972261 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 435/864] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:37 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:38.338834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-b0904010-5013-4a6e-aec0-a6e104a64769 req-131d1618-e4a4-4f31-ab22-9b9fe9689e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "name": "network-vif-plugged", "status": "completed", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:38.351221 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b0904010-5013-4a6e-aec0-a6e104a64769 req-131d1618-e4a4-4f31-ab22-9b9fe9689e93 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:38.351707 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b0904010-5013-4a6e-aec0-a6e104a64769 req-131d1618-e4a4-4f31-ab22-9b9fe9689e93 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:38.352384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b0904010-5013-4a6e-aec0-a6e104a64769 req-131d1618-e4a4-4f31-ab22-9b9fe9689e93 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:38.369231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-b0904010-5013-4a6e-aec0-a6e104a64769 req-131d1618-e4a4-4f31-ab22-9b9fe9689e93 service nova] Creating event network-vif-plugged:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:15:38.375128 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-b0904010-5013-4a6e-aec0-a6e104a64769 req-131d1618-e4a4-4f31-ab22-9b9fe9689e93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039892 Sep 09 21:15:38.375811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 430/865] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:38.507365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:38.508374 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:38.514602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:38.515025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:38.515461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:38.516189 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:38.516823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:38.517245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:38.645074 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-fbe2c30a-f094-4b50-b965-6f3dde5200e0 req-db714765-63e4-4957-b1f7-133750a5ae5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ebe09d2-d39e-4a97-8874-35ed94d47f18", "tag": "949c9575-c043-4321-91ce-af2656a3e70c"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:38.663671 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:38.665701 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-fbe2c30a-f094-4b50-b965-6f3dde5200e0 req-db714765-63e4-4957-b1f7-133750a5ae5b service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:38.666413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-fbe2c30a-f094-4b50-b965-6f3dde5200e0 req-db714765-63e4-4957-b1f7-133750a5ae5b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:38.666944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-fbe2c30a-f094-4b50-b965-6f3dde5200e0 req-db714765-63e4-4957-b1f7-133750a5ae5b service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:38.678321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:38.681040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-fbe2c30a-f094-4b50-b965-6f3dde5200e0 req-db714765-63e4-4957-b1f7-133750a5ae5b service nova] Creating event network-changed:949c9575-c043-4321-91ce-af2656a3e70c for instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 on hv-cinder-83124 Sep 09 21:15:38.685581 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:38.686748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-fbe2c30a-f094-4b50-b965-6f3dde5200e0 req-db714765-63e4-4957-b1f7-133750a5ae5b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047109 Sep 09 21:15:38.687037 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bde85265-eb6c-4981-adea-65cd9e84d439 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.183583 Sep 09 21:15:38.687550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 431/866] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:15:38.693185 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 436/867] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:38 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:38.997761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:38.998453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:39.004811 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:39.005297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:39.005737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:39.006430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:39.006885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:39.007311 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:39.135623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:39.143272 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8449ea94-8dbe-4c65-a9b4-852bbd973733 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.150030 Sep 09 21:15:39.143823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 437/868] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:38 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:39.714693 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:39.715408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:39.721467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:39.721946 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:39.722381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:39.723063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:39.723511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:39.723936 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:39.879810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:39.888554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:39.889994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:39.891168 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1abc86e7-9fd1-4b3e-975b-0f9fdedae1cc tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.181235 Sep 09 21:15:39.891887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 432/869] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:39 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:39.895660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:39.896305 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:39.902880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:39.903482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:39.904024 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:39.904857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:39.905418 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:39.905958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:39.929228 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d7939be9-7a6f-4a45-9a18-c1da36d43417 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/ips" status: 200 len: 146 microversion: 2.1 time: 0.037603 Sep 09 21:15:39.929962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 438/870] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:15:39 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:40.165778 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:40.166384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:40.173077 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:40.173779 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:40.174395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:40.175094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:40.175687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:40.176137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:40.350407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:40.359028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-74ba1797-67b2-47ae-8931-8c80e9b30dbb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.197262 Sep 09 21:15:40.359850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 433/871] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:40 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:40.915592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:40.916248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:40.923159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:40.923667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:40.924116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:40.924822 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:40.925273 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:40.925817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:41.055937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:41.064537 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:41.065978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:41.067127 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7ac1bbc6-d89a-4351-9579-0c99afe6e386 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.155470 Sep 09 21:15:41.067674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 439/872] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:40 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:41.382047 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:41.382689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:41.389174 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:41.389676 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:41.390106 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:41.390947 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:41.391397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:41.391816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:41.525019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:41.533673 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f5bc93af-3860-4da3-b90f-9064ed448c73 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.155386 Sep 09 21:15:41.534329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 434/873] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:41 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:42.093014 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:42.094103 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:42.100431 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:42.100907 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:42.101369 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:42.102051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:42.102498 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:42.102914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:42.117749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:42.230106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:42.238505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:42.239931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:42.241104 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-eb2158a4-8c6d-4e5c-b819-be69a04f80a3 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1729 microversion: 2.20 time: 0.152055 Sep 09 21:15:42.241653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 440/874] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:42 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:15:42.556757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:42.557375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:42.563881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:42.564391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:42.564829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:42.565512 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:42.566009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:42.566428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:42.690055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29086ab6-7012-45fd-bbe6-6917043dc65d"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:42.692557 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:42.693660 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:42.698434 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:42.698911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:42.699343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:42.700032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:42.700503 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:42.700918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:42.701727 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-393c8eb2-a411-4f1f-b7c2-54ce083c2a82 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.149057 Sep 09 21:15:42.702311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 435/875] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:42 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:43.266277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:43.266826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:43.272823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:43.273311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:43.273753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:43.274501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:43.274955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:43.275385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:43.403545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:43.412347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:43.413802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:43.414959 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-86ae318d-e926-4a0a-8565-3b2365e1836f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1716 microversion: 2.20 time: 0.152780 Sep 09 21:15:43.415516 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 436/876] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:15:43 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 21:15:43.669380 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-43feb67e-e091-4a96-9a1b-cf8a17744d49 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.983466 Sep 09 21:15:43.674883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 441/877] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:15:42 2022] POST /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments => generated 194 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:43.725476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:43.726101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:43.732511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:43.733005 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:43.733445 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:43.734806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:43.735271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:43.735700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:43.865140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:43.872844 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8b6ed4aa-0315-40d7-9e98-00f3a791d3fb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.151232 Sep 09 21:15:43.873428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 437/878] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:43 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:44.893135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:44.897451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:44.898323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:44.907718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:44.908032 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:44.908595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:44.909206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:44.909657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:44.912522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:45.038435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:45.046004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0f939b4e-2717-4114-9617-3a311f97ef19 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.154409 Sep 09 21:15:45.047212 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 442/879] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:44 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:46.069421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:46.069953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:46.071905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:46.072591 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:46.077797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:46.078287 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:46.078726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:46.079447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:46.079904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:46.080706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:46.210471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:46.218167 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3e5ab405-510b-4f00-ba71-2ea2a3d09c97 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.152745 Sep 09 21:15:46.218733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 438/880] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:46 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:46.494065 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-b32bef76-cf21-4241-9d8c-242541334a2d req-6eb0fc79-adbf-4f4d-8f60-22c7e93d6d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebe09d2-d39e-4a97-8874-35ed94d47f18", "name": "network-vif-plugged", "status": "completed", "tag": "949c9575-c043-4321-91ce-af2656a3e70c"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:46.503932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-b32bef76-cf21-4241-9d8c-242541334a2d req-6eb0fc79-adbf-4f4d-8f60-22c7e93d6d9d service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:46.504485 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-b32bef76-cf21-4241-9d8c-242541334a2d req-6eb0fc79-adbf-4f4d-8f60-22c7e93d6d9d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:46.504909 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-b32bef76-cf21-4241-9d8c-242541334a2d req-6eb0fc79-adbf-4f4d-8f60-22c7e93d6d9d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:46.515505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-b32bef76-cf21-4241-9d8c-242541334a2d req-6eb0fc79-adbf-4f4d-8f60-22c7e93d6d9d service nova] Creating event network-vif-plugged:949c9575-c043-4321-91ce-af2656a3e70c for instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 on hv-cinder-83124 Sep 09 21:15:46.520286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-b32bef76-cf21-4241-9d8c-242541334a2d req-6eb0fc79-adbf-4f4d-8f60-22c7e93d6d9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 Sep 09 21:15:46.520848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 443/881] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:47.241226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:47.241774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:47.248238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:47.248731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:47.249173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:47.249909 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:47.250367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:47.250798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:47.380989 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:47.388612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-162d5126-1d59-47b5-a0ff-c61a44195827 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.151327 Sep 09 21:15:47.389175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 439/882] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:47 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:48.411665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:48.412387 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:48.418348 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:48.418827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:48.419298 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:48.419981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:48.420465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:48.432746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:48.548948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:48.556560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6cc088e0-6992-4f8e-81bc-d5551a670ebb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1313 microversion: 2.1 time: 0.149599 Sep 09 21:15:48.557147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 444/883] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:48 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:49.579374 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:49.580026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:49.586717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:49.587196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:49.587629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:49.588347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:49.588799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:49.589225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:49.718453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:49.726036 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4dd86391-2bba-4d42-a7c0-6a38e1c12d9d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1497 microversion: 2.1 time: 0.151168 Sep 09 21:15:49.726610 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 440/884] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:49 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:50.808941 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:50.811831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:50.816370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:50.816891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:50.817321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:50.818010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:50.818456 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:50.818918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:50.846408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:15:51.064789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-cb4d4b73-0991-4209-957c-0955da399e3d tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 204 len: 0 microversion: 2.1 time: 0.259324 Sep 09 21:15:51.065405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 445/885] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:15:50 2022] DELETE /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:15:51.073471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:51.074086 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:51.081354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:51.081836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:51.082298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:51.082984 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:51.083433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:51.083863 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:51.210156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:51.217920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-41b272e9-26cd-46c8-8dc8-dc2db222fd58 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1503 microversion: 2.1 time: 0.148246 Sep 09 21:15:51.218495 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 441/886] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:51 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:51.408056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:51.410646 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:51.416496 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:51.416977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:51.417403 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:51.418157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:51.418630 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:51.419047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:51.449497 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f36b5253-4548-4413-b829-ea4df52c7057 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Sep 09 21:15:51.450053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 446/887] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:15:51 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:51.460934 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:51.461431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:51.467317 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:51.467799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:51.468281 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:51.469019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:51.469478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:51.469960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:51.499171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7808df54-81c9-44dd-938a-f0e74523f428 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/29086ab6-7012-45fd-bbe6-6917043dc65d" status: 200 len: 194 microversion: 2.1 time: 0.042093 Sep 09 21:15:51.499829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 442/888] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Sep 9 21:15:51 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/29086ab6-7012-45fd-bbe6-6917043dc65d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:52.241201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:52.241844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:52.248214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:52.248689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:52.254948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:52.254948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:52.254948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:52.254948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:52.376605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:52.384188 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-70435369-b25f-44a4-9c8f-548e784a3d7e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1503 microversion: 2.1 time: 0.146796 Sep 09 21:15:52.384756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 447/889] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:52 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:53.407484 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:53.408120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:53.414196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:53.414678 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:53.415113 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:53.415805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:53.416291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:53.416719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:53.550046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:53.557732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d19669d5-8b00-4321-9e70-82d48e947458 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1503 microversion: 2.1 time: 0.154122 Sep 09 21:15:53.558370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 443/890] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:53 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:54.581957 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:54.582575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:54.588934 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:54.589415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:54.589850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:54.590540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:54.590991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:54.591408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:54.721513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:54.729200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b1591d16-86d0-4065-b9c0-c0fa88cd344f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1503 microversion: 2.1 time: 0.151922 Sep 09 21:15:54.729756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 448/891] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:54 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:55.753492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:55.754119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:55.756514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:55.761054 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:55.761557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:55.761987 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:55.762673 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:55.763136 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:55.763539 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:55.893901 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:55.901492 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-160dee4c-10cd-4394-a181-f55b2684163c tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1503 microversion: 2.1 time: 0.152611 Sep 09 21:15:55.902052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 444/892] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:55 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:56.240058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f050d54-d737-47a6-b5e8-c2500fd8d18c"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:56.242538 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:56.251229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:56.251409 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:56.251845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:56.252568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:56.253021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:56.253442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:56.924418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:56.925050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:56.932301 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:56.932798 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:56.933240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:56.933951 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:56.934408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:56.934833 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:57.127061 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-271ed6f7-b42e-440c-b5dc-ac415e8b05c5 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "POST /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891275 Sep 09 21:15:57.128008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 449/893] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:15:56 2022] POST /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:57.189791 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:57.197311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-eeb4ba60-04d0-46ca-88d0-f1b28c20d1e4 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1503 microversion: 2.1 time: 0.277340 Sep 09 21:15:57.197871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 445/894] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:56 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:15:57.316288 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-9da8f158-003e-4e5c-bf00-30b60ddb83b1 req-9265f205-f092-4b58-99c0-2fd3b3a70801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ebe09d2-d39e-4a97-8874-35ed94d47f18", "name": "network-vif-deleted", "tag": "949c9575-c043-4321-91ce-af2656a3e70c"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:57.327762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9da8f158-003e-4e5c-bf00-30b60ddb83b1 req-9265f205-f092-4b58-99c0-2fd3b3a70801 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:57.328346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9da8f158-003e-4e5c-bf00-30b60ddb83b1 req-9265f205-f092-4b58-99c0-2fd3b3a70801 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:57.329126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-9da8f158-003e-4e5c-bf00-30b60ddb83b1 req-9265f205-f092-4b58-99c0-2fd3b3a70801 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:57.340541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-9da8f158-003e-4e5c-bf00-30b60ddb83b1 req-9265f205-f092-4b58-99c0-2fd3b3a70801 service nova] Creating event network-vif-deleted:949c9575-c043-4321-91ce-af2656a3e70c for instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 on hv-cinder-83124 Sep 09 21:15:57.345364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-9da8f158-003e-4e5c-bf00-30b60ddb83b1 req-9265f205-f092-4b58-99c0-2fd3b3a70801 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Sep 09 21:15:57.345929 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 450/895] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:15:58.221040 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:58.221787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:58.228365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:58.228855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:58.229296 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:58.229997 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:58.230453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:58.230941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:58.251278 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:15:58.264035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:58.264550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:58.264992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:58.265438 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lazy-loading 'fault' on Instance uuid 4ebe09d2-d39e-4a97-8874-35ed94d47f18 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:15:58.305151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:15:58.312959 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9030430f-e547-427f-a91e-410f3fa97ec2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 200 len: 1303 microversion: 2.1 time: 0.095828 Sep 09 21:15:58.314213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 446/896] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:58 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:15:59.337415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:59.338157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 4ebe09d2-d39e-4a97-8874-35ed94d47f18] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:15:59.344132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:59.345146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:59.345573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:59.346249 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:59.346695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:59.347114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:59.359759 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] HTTP exception thrown: Instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 could not be found. Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Request method failure captured: Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 HTTP/1.1 Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6zyuaJqTflWmwpW8aqU7VXrco83vl4ikYz_57JeUpV0y-VrynSSc_w4D3YO2mt7zLYwlvS5lde40ifw-sBfWrXvMFzsIic1JZi6XNfHcIPN4kY_5-P5GLQ12oE1gc_XhoDD0RAN_JfbnNHf3C8tyR7lQVM_k0d8ZoeTpU4-_JEu_9Y Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 684ee48934f949499a7c77d782372b53 Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesActionsTest-636753775 Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:15:59.361919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684ee48934f949499a7c77d782372b53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684ee48934f949499a7c77d782372b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684ee48934f949499a7c77d782372b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684ee48934f949499a7c77d782372b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesActionsTest-636753775 Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 684ee48934f949499a7c77d782372b53 Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesActionsTest-636753775 Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesActionsTest-636753775-project Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 3ce5a94e8c594b8d813ab8e6d39633af Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesActionsTest-636753775-project Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 could not be found. Sep 09 21:15:59.363579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '4ebe09d2-d39e-4a97-8874-35ed94d47f18'} Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 could not be found. Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:15:59.364502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 could not be found. Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 could not be found. Sep 09 21:15:59.366026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:15:59.367367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Returning 404 to user: Instance 4ebe09d2-d39e-4a97-8874-35ed94d47f18 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:15:59.367367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-14ada0b0-2c28-4679-84e9-a87f6dfa8080 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18" status: 404 len: 111 microversion: 2.1 time: 0.030454 Sep 09 21:15:59.367367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 451/897] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:59 2022] GET /compute/v2.1/servers/4ebe09d2-d39e-4a97-8874-35ed94d47f18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:15:59.411705 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-274557390", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "networks": [{"uuid": "db21fc85-6727-4510-ba40-41044bcdfd71"}]}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:15:59.465478 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] validate_networks() for [('db21fc85-6727-4510-ba40-41044bcdfd71', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:15:59.814192 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:15:59.814616 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:15:59.815099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:15:59.815498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:15:59.815910 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:15:59.824608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:59.825089 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:59.825525 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:59.826306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:15:59.826735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:15:59.827161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:15:59.843629 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Getting quotas for project 684ee48934f949499a7c77d782372b53. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:15:59.848037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Getting quotas for user 3ce5a94e8c594b8d813ab8e6d39633af and project 684ee48934f949499a7c77d782372b53. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:15:59.858785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:15:59.861650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:15:59.974210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7f95debc-b85f-4518-a3bb-b360be99f3b9 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567102 Sep 09 21:15:59.974853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 447/898] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:15:59.986720 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2a16a058-6fe7-450d-8550-40aec1c4a6f2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:15:59.987331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2a16a058-6fe7-450d-8550-40aec1c4a6f2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:00.044443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2a16a058-6fe7-450d-8550-40aec1c4a6f2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:00.051801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2a16a058-6fe7-450d-8550-40aec1c4a6f2 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1213 microversion: 2.1 time: 0.069609 Sep 09 21:16:00.052381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 452/899] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:15:59 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:01.075380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:01.076020 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:01.083865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:01.084375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:01.084813 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:01.085493 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:01.086039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:01.086508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:01.148967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:01.156683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-66f92739-89da-481e-8287-0559d71c3669 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1217 microversion: 2.1 time: 0.086172 Sep 09 21:16:01.157810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 448/900] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:01 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:01.687685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-52901935", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-704010936", "security_groups": [{"name": "tempest-secgroup-smoke-27864544"}], "block_device_mapping_v2": [{"uuid": "cf18490a-f7f1-4b08-860c-191f65870cf1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ca317ead-021d-4181-81fb-569564a685ee"}]}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:01.805033 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] validate_networks() for [('ca317ead-021d-4181-81fb-569564a685ee', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:16:02.180124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:02.180868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:02.187284 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:02.187767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:02.188251 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:02.188952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:02.189406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:02.189830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:02.235998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:16:02.236524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:16:02.237089 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:16:02.237578 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:16:02.238056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:16:02.247216 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:02.247774 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:02.248393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:02.249230 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:02.249749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:02.250245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:02.255430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:02.263265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-43501508-8bb3-4520-b5af-957e6f359f99 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1265 microversion: 2.1 time: 0.087129 Sep 09 21:16:02.266064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 449/901] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:02 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:02.270056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:16:02.274129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Getting quotas for user f289a1bdd79b4ba0bf9499edb7729c9a and project c8403c10131d45b7a3f34ae872ac9e9e. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:16:02.345718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:16:02.347842 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf18490a-f7f1-4b08-860c-191f65870cf1',volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:16:02.856161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-205056ef-edf3-4d77-86f6-57f7a5dc226f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.172876 Sep 09 21:16:02.863706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 453/902] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:16:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:16:02.869124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1d837169-a434-4ffa-ae6e-5627672b3612 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:02.874945 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1d837169-a434-4ffa-ae6e-5627672b3612 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:02.936393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1d837169-a434-4ffa-ae6e-5627672b3612 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:02.939870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1d837169-a434-4ffa-ae6e-5627672b3612 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1092 microversion: 2.1 time: 0.074802 Sep 09 21:16:02.940645 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 450/903] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:02 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:03.287132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:03.287748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:03.294437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:03.297426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:03.297426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:03.297426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:03.297426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:03.298066 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:03.552192 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:03.560597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-61c48f8c-55dc-4db5-8ea0-c5ea72b84141 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.277275 Sep 09 21:16:03.561152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 454/904] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:03 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:03.962548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:03.963173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:03.970718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:03.971213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:03.971652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:03.972385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:03.972847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:03.973282 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:04.048975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:04.056594 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-bc2fb1d7-ca1a-4b56-a6fb-6438d9a8d596 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1142 microversion: 2.1 time: 0.097960 Sep 09 21:16:04.057146 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 451/905] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:03 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1142 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:04.166398 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-29b8a931-c9fd-474d-bcc8-98a2e5c302a3 req-36961a33-353b-42bb-b523-3c4632b30b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da49ff6-e0f1-4367-8335-31341a3534d1", "tag": "48faab35-4eec-4627-9d7b-b81acf566fcc"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:04.171951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:04.178366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-29b8a931-c9fd-474d-bcc8-98a2e5c302a3 req-36961a33-353b-42bb-b523-3c4632b30b7d service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:04.179130 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-29b8a931-c9fd-474d-bcc8-98a2e5c302a3 req-36961a33-353b-42bb-b523-3c4632b30b7d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:04.179779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-29b8a931-c9fd-474d-bcc8-98a2e5c302a3 req-36961a33-353b-42bb-b523-3c4632b30b7d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:04.192706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-29b8a931-c9fd-474d-bcc8-98a2e5c302a3 req-36961a33-353b-42bb-b523-3c4632b30b7d service nova] Creating event network-changed:48faab35-4eec-4627-9d7b-b81acf566fcc for instance 8da49ff6-e0f1-4367-8335-31341a3534d1 on hv-cinder-83124 Sep 09 21:16:04.197724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-29b8a931-c9fd-474d-bcc8-98a2e5c302a3 req-36961a33-353b-42bb-b523-3c4632b30b7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034974 Sep 09 21:16:04.198425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 455/906] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:04.584562 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:04.585776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:04.593053 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:04.593768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:04.594853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:04.595635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:04.596305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:04.596538 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:04.729011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:04.736615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-785258f0-f45a-4cfd-ac1f-eb5412ded6a6 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.156312 Sep 09 21:16:04.737177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 452/907] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:04 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:05.082846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:05.083563 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:05.090621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:05.091209 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:05.091650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:05.092408 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:05.092862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:05.093279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:05.181000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:05.192452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e9964353-57d1-4662-be02-981b0f2dc61f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1198 microversion: 2.1 time: 0.113863 Sep 09 21:16:05.193384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 456/908] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:05 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1198 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:05.758621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:05.759239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:05.765624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:05.766612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:05.767049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:05.767759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:05.768240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:05.768661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:05.894361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:05.901749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e3034d36-5b89-4889-8cac-3a56d7c45d2e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.146977 Sep 09 21:16:05.902312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 453/909] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:05 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:06.217321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:06.217931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:06.224381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:06.224859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:06.225286 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:06.225968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:06.226412 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:06.226826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:06.229493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:06.292421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:06.300605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7f0202b6-6208-4c2a-a2b4-f7d0dffd208e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1208 microversion: 2.1 time: 0.087439 Sep 09 21:16:06.301154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 457/910] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:06 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:06.924706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:06.925257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:06.931599 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:06.932091 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:06.932550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:06.933239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:06.933691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:06.934111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:07.058472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:07.066010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fe6189bd-a29c-4a7f-b4ff-aa4b566dca93 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.145844 Sep 09 21:16:07.066571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 454/911] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:06 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:07.323862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:07.324535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:07.332463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:07.334896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:07.334896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:07.334896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:07.334896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:07.335228 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:07.394705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:07.402292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2fc6351a-a0c5-437a-87a1-8a0544125684 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1208 microversion: 2.1 time: 0.082274 Sep 09 21:16:07.402817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 458/912] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:07 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:08.089546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:08.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:08.096661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:08.097140 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:08.097571 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:08.098256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:08.098703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:08.099120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:08.225668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:08.233217 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-991583ad-3e44-4012-85ee-c9d988350194 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.147617 Sep 09 21:16:08.233769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 455/913] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:08 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:08.425211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:08.425827 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:08.432195 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:08.432680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:08.433122 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:08.433833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:08.434284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:08.434728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:08.499673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:08.508365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7f37eb17-6e73-40e2-8487-3743f69b9c13 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1208 microversion: 2.1 time: 0.086971 Sep 09 21:16:08.509010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 459/914] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:08 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:09.256486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:09.257126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:09.268404 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.271436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.271887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.272639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.273111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.273522 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.402497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:09.410874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1b4dafe5-88a0-4ebf-94f7-f17ecaf50e6e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.159196 Sep 09 21:16:09.411455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 456/915] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:09 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:09.531271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:09.532521 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:09.540621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.541127 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.544981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.545710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.546170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.546597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.690856 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:09.698491 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-34ecf37a-1f95-4aff-bb70-122f15d9992a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1274 microversion: 2.1 time: 0.171389 Sep 09 21:16:09.699042 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 460/916] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:09 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:09.948729 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:09.950992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:09.952872 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:09.958976 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.960201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.960201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.960842 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.961308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.961814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.967067 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-d2301f21-16cc-4a13-ae34-765feb61d5f4 req-0b090be8-bc73-44a6-8e66-cff67db7c3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1665449d-cc36-47d4-b303-d0d82c5a5400", "tag": "8df13260-c81f-4a37-939e-ba952ce1f3f8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:09.978480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-d2301f21-16cc-4a13-ae34-765feb61d5f4 req-0b090be8-bc73-44a6-8e66-cff67db7c3dc service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:09.979486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-d2301f21-16cc-4a13-ae34-765feb61d5f4 req-0b090be8-bc73-44a6-8e66-cff67db7c3dc service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:09.980043 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-d2301f21-16cc-4a13-ae34-765feb61d5f4 req-0b090be8-bc73-44a6-8e66-cff67db7c3dc service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:09.998914 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-76e28868-d590-4587-ad74-8f3afc0717fe tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054086 Sep 09 21:16:09.999898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 457/917] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:16:09 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:10.007863 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-d2301f21-16cc-4a13-ae34-765feb61d5f4 req-0b090be8-bc73-44a6-8e66-cff67db7c3dc service nova] Creating event network-changed:8df13260-c81f-4a37-939e-ba952ce1f3f8 for instance 1665449d-cc36-47d4-b303-d0d82c5a5400 on hv-cinder-83124 Sep 09 21:16:10.014583 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-d2301f21-16cc-4a13-ae34-765feb61d5f4 req-0b090be8-bc73-44a6-8e66-cff67db7c3dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051187 Sep 09 21:16:10.015322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 461/918] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:10.141564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:10.142107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:10.148588 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.149080 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.149524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.150228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.150690 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.151121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.181344 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f7b8a6b3-8892-4096-8fc4-c45e563c2344 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/29086ab6-7012-45fd-bbe6-6917043dc65d" status: 200 len: 194 microversion: 2.1 time: 0.043358 Sep 09 21:16:10.181870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 458/919] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Sep 9 21:16:10 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/29086ab6-7012-45fd-bbe6-6917043dc65d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:10.193215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:10.193798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:10.199775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.200290 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.200725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.201414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.201860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.202280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.282813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lazy-loading 'services' on Instance uuid 9af5f313-0ae0-4c98-8823-c398127b8fd1 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:16:10.434160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:10.434846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:10.445031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.445535 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.445970 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.446682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.447139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.447567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.504449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-86996622-6987-45ea-97ed-1e4bc5c9576c tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/29086ab6-7012-45fd-bbe6-6917043dc65d" status: 202 len: 0 microversion: 2.1 time: 0.315300 Sep 09 21:16:10.511056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 462/920] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:16:10 2022] DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/29086ab6-7012-45fd-bbe6-6917043dc65d => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:16:10.630596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:10.639898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f56af182-fd04-4c84-bce6-5dae1e08ba9e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.209293 Sep 09 21:16:10.640720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 459/921] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:10 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:10.687125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-13d24647-f97c-458e-86e5-e6025d04e4be req-3be3b0cf-ba4d-4f1b-9cfd-5d2c0f026aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da49ff6-e0f1-4367-8335-31341a3534d1", "name": "network-vif-plugged", "status": "completed", "tag": "48faab35-4eec-4627-9d7b-b81acf566fcc"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:10.700550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-13d24647-f97c-458e-86e5-e6025d04e4be req-3be3b0cf-ba4d-4f1b-9cfd-5d2c0f026aba service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.701333 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-13d24647-f97c-458e-86e5-e6025d04e4be req-3be3b0cf-ba4d-4f1b-9cfd-5d2c0f026aba service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.702134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-13d24647-f97c-458e-86e5-e6025d04e4be req-3be3b0cf-ba4d-4f1b-9cfd-5d2c0f026aba service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.731255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:10.731255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:10.731486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-13d24647-f97c-458e-86e5-e6025d04e4be req-3be3b0cf-ba4d-4f1b-9cfd-5d2c0f026aba service nova] Creating event network-vif-plugged:48faab35-4eec-4627-9d7b-b81acf566fcc for instance 8da49ff6-e0f1-4367-8335-31341a3534d1 on hv-cinder-83124 Sep 09 21:16:10.731601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.731601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.731994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.732799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:10.733891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-13d24647-f97c-458e-86e5-e6025d04e4be req-3be3b0cf-ba4d-4f1b-9cfd-5d2c0f026aba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053833 Sep 09 21:16:10.734024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:10.734598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:10.734752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 463/922] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:16:10.877734 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:10.885376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-95a1c3f1-1a2a-4ab5-b8d5-1d90080af547 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1274 microversion: 2.1 time: 0.166766 Sep 09 21:16:10.885939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 460/923] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:10 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:11.663342 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:11.664047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:11.670299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:11.670776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:11.671211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:11.672438 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:11.673070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:11.673535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:11.799770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:11.807497 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7734cf26-dc9f-4d70-97ed-3e24a17c2a45 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.148460 Sep 09 21:16:11.808052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 464/924] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:11 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:11.909423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:11.910043 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:11.916460 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:11.916947 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:11.917384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:11.918106 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:11.918563 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:11.918990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:12.045858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:12.054176 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-65d45d52-3e29-418c-a7b7-25bed72c8301 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.149153 Sep 09 21:16:12.054744 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 461/925] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:11 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:12.831679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:12.832260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:12.834235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:12.834913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=8 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:12.840110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:12.845752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:12.845752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:12.845752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:12.845752 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:12.846142 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:12.971191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:12.978932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-09480477-e91a-4625-944a-36301d20daa0 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.151974 Sep 09 21:16:12.979455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 465/926] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:12 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:13.077648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:13.078404 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:13.084529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=8 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:13.086504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:13.086992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:13.087434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:13.088165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:13.088653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:13.089077 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:13.219136 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:13.227248 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-59879466-22c8-4aca-8222-8da308293dd6 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.153544 Sep 09 21:16:13.227919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 462/927] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:13 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:13.767407 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:13.767897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:13.773798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:13.774270 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:13.774696 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:13.775376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:13.775825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:13.776269 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:13.804911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-73a21c03-ab44-4eb7-9b3e-59bb394faf46 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/6f050d54-d737-47a6-b5e8-c2500fd8d18c" status: 200 len: 194 microversion: 2.1 time: 0.041975 Sep 09 21:16:13.805480 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 466/928] 10.222.0.48 () {58 vars in 1413 bytes} [Fri Sep 9 21:16:13 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/6f050d54-d737-47a6-b5e8-c2500fd8d18c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:13.815816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:13.816380 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:13.822379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:13.822867 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:13.823309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:13.824009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:13.824505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:13.824932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:13.903316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lazy-loading 'services' on Instance uuid 9af5f313-0ae0-4c98-8823-c398127b8fd1 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:16:14.001028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:14.002435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:14.003149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:14.009636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:14.010439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:14.011000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:14.011794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:14.012360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:14.012846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:14.075828 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-47b67321-00c5-40d4-a8c3-a4f7788441e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/6f050d54-d737-47a6-b5e8-c2500fd8d18c" status: 202 len: 0 microversion: 2.1 time: 0.263771 Sep 09 21:16:14.077090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 463/929] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:16:13 2022] DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments/6f050d54-d737-47a6-b5e8-c2500fd8d18c => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:16:14.146000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:14.154029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-cfd59657-0602-4f59-b740-73cab024847e tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1313 microversion: 2.1 time: 0.155635 Sep 09 21:16:14.156607 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 467/930] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:13 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:14.252031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:14.252718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:14.259102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:14.259589 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:14.260144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:14.260851 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:14.261306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:14.261732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:14.389184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:14.397411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d9b2e970-ecac-40c4-b6ac-9e7be50ca09b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.151072 Sep 09 21:16:14.397977 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 464/931] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:14 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:15.177453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:15.178068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:15.184607 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:15.185178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:15.185611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:15.186307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:15.186795 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:15.187220 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:15.313612 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:15.322074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-73ed4c1e-555c-428a-b336-cb19e883f74f tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1497 microversion: 2.1 time: 0.148377 Sep 09 21:16:15.328661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 468/932] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:15 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:15.419892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:15.420522 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:15.426797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:15.427275 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:15.427704 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:15.428413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:15.428866 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:15.429290 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:15.563603 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:15.572481 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-40920bf9-68f1-4d35-81ff-2fbf0ab53a14 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.155908 Sep 09 21:16:15.573514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 465/933] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:15 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:16.261075 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.261569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.268341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.268882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.269320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.270040 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.270493 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.270911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.295410 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:16:16.315335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.317715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.323659 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.324183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.324657 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.325357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.325815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.326239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.355293 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-119eace3-2f75-46b1-b4f0-2bdd7c0ba077 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044523 Sep 09 21:16:16.355846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 466/934] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:16:16 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 21:16:16.473184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.475346 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.481782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.482269 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.482724 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.483404 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.483864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.484322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.513059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4a2586de-d741-4a50-8713-fdab9a1f4be3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044290 Sep 09 21:16:16.513624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 467/935] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:16:16 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 21:16:16.578108 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.578649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.585031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.589125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.589125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.589125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.589125 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.589499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.602215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-32d78d90-aedb-46d5-807a-28ff020e6069 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 204 len: 0 microversion: 2.1 time: 0.344800 Sep 09 21:16:16.602808 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 469/936] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:16:16 2022] DELETE /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:16:16.609483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.610736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.615533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:16:16.616525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.617101 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.617439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.618429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.618581 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.619010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.766108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:16.774132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0b97d293-8dbb-4598-9dc3-fb0f68c39ba8 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.168542 Sep 09 21:16:16.774759 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 470/937] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:16 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:16.779384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.779989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.785643 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.786122 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.786586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.787312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.787767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.788339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.841305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c5001c21-1fb1-429c-8ba3-38410b51161b tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 204 len: 0 microversion: 2.1 time: 0.266777 Sep 09 21:16:16.841910 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 468/938] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:16:16 2022] DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 21:16:16.850474 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:16.851242 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:16.857022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.857511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.857952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.858652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:16.859113 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:16.859542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:16.948845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:16.957579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7aa42a3b-70ad-4293-8961-dfc999e9eb68 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1503 microversion: 2.1 time: 0.181575 Sep 09 21:16:16.958052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 471/939] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:16 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:17.007933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:17.015718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-50dde256-3b42-449f-b682-d206628e564d tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1673 microversion: 2.1 time: 0.169309 Sep 09 21:16:17.016837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 469/940] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:16 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:17.797279 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:17.797888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:17.804360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:17.804849 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:17.805289 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:17.805980 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:17.806433 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:17.806858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:17.940097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:17.942469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:17.948899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bbad3683-8d04-4b59-a7a4-8782cd1c1edd tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.155551 Sep 09 21:16:17.949459 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 472/941] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:17 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:17.980726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:17.981342 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:17.987815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:17.988333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:17.988772 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:17.989501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:17.989957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:17.990386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:18.040852 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:18.041462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:18.048306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:18.048722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:18.049153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:18.049836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:18.050282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:18.050701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:18.159923 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:18.167635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e490af04-b23f-4f26-a9e7-f698ba4ea4eb tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1503 microversion: 2.1 time: 0.190775 Sep 09 21:16:18.168227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 470/942] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:17 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:18.201887 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:18.210263 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5f04e305-bf1d-44ac-a9b3-2b18dbd88e27 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1673 microversion: 2.1 time: 0.173717 Sep 09 21:16:18.210824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 473/943] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:18 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:18.973981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:18.974624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:18.980583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:18.981068 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:18.981616 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:18.982192 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:18.982648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:18.983073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:19.113770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:19.121346 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-360f0fc9-8856-451a-94bf-6682bbc67892 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.151862 Sep 09 21:16:19.121906 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 471/944] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:18 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:19.191219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:19.191832 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:19.198167 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:19.198649 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:19.199084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:19.199771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:19.200256 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:19.200681 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:19.232776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:19.233315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:19.239720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:19.240247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:19.240685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:19.241385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:19.241838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:19.242259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:19.378883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:19.386669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c4e8207a-9269-4bc0-893f-53e901679d13 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1503 microversion: 2.1 time: 0.199186 Sep 09 21:16:19.387244 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 474/945] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:19 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:19.407471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:19.415132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ad1ff3ee-cf78-4766-a2a6-73ed3d1d82e4 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1673 microversion: 2.1 time: 0.186302 Sep 09 21:16:19.415682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 472/946] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:19 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:20.144114 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:20.144673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:20.150568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:20.151051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:20.151484 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:20.152198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:20.152653 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:20.153079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:20.279762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:20.287531 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5a6ffa05-36de-4384-bf3e-a15ca8fda609 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.147389 Sep 09 21:16:20.288106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 475/947] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:20 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:20.409482 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:20.410107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:20.416613 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:20.417101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:20.417542 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:20.418236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:20.418698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:20.419129 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:20.439788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:20.440457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:20.446364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:20.446861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:20.447297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:20.448091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:20.448552 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:20.448975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:20.866389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:20.874282 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:20.876212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e5dcc0b0-f69f-4c3f-b077-29242b586478 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1503 microversion: 2.1 time: 0.469274 Sep 09 21:16:20.877031 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 473/948] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:20 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1503 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:20.883131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ea256493-4c8f-42da-a066-0613d9aee1d3 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1673 microversion: 2.1 time: 0.448319 Sep 09 21:16:20.883787 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 476/949] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:20 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1673 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:21.273101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-b5698ff2-2c8d-4675-a1ec-d1a0dc65118c req-8f2aec89-d43f-4983-af41-abed6ff5cd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da49ff6-e0f1-4367-8335-31341a3534d1", "name": "network-vif-deleted", "tag": "48faab35-4eec-4627-9d7b-b81acf566fcc"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:21.284506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b5698ff2-2c8d-4675-a1ec-d1a0dc65118c req-8f2aec89-d43f-4983-af41-abed6ff5cd7e service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.285022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b5698ff2-2c8d-4675-a1ec-d1a0dc65118c req-8f2aec89-d43f-4983-af41-abed6ff5cd7e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.285410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b5698ff2-2c8d-4675-a1ec-d1a0dc65118c req-8f2aec89-d43f-4983-af41-abed6ff5cd7e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.298753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-b5698ff2-2c8d-4675-a1ec-d1a0dc65118c req-8f2aec89-d43f-4983-af41-abed6ff5cd7e service nova] Creating event network-vif-deleted:48faab35-4eec-4627-9d7b-b81acf566fcc for instance 8da49ff6-e0f1-4367-8335-31341a3534d1 on hv-cinder-83124 Sep 09 21:16:21.303454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-b5698ff2-2c8d-4675-a1ec-d1a0dc65118c req-8f2aec89-d43f-4983-af41-abed6ff5cd7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Sep 09 21:16:21.304037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 474/950] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:21.310111 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:21.310717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:21.316991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.317477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.317908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.318594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.319039 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.319457 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.451232 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:21.460224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4fa124a8-9ccc-4bcd-8e92-733c736f491d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.153809 Sep 09 21:16:21.460798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 477/951] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:21 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:21.900553 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:21.901249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:21.907547 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.908035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.908228 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:21.908846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.909186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:21.909747 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.910209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.910638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.917179 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.918044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.918795 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.919724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.920364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.920799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.950881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:21.951573 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:21.952213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:21.952829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lazy-loading 'fault' on Instance uuid 8da49ff6-e0f1-4367-8335-31341a3534d1 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:16:22.044516 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce5a94e8c594b8d813ab8e6d39633af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684ee48934f949499a7c77d782372b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:22.053688 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-03c2bcad-b6d2-4ce3-9872-1a542c60d4dd tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 200 len: 1303 microversion: 2.1 time: 0.158067 Sep 09 21:16:22.054740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 475/952] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:21 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:22.108864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:22.116695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f015b5b3-1a87-4d9b-95d8-3981f4ec3681 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1673 microversion: 2.1 time: 0.213944 Sep 09 21:16:22.117262 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 478/953] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:21 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:22.483753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:22.484394 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:22.491183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:22.491906 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:22.492494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:22.493298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:22.493948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:22.494497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:22.665583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:22.674733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1c6cbed6-54b4-4ed7-ad5f-d03ac5481c64 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.194967 Sep 09 21:16:22.675537 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 476/954] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:22 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:23.059522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-51e6e7f7-d9b4-4be3-97c9-d6464e2f5b43 req-4cfbd292-b1f5-4d0d-891b-aebcc6ada865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1665449d-cc36-47d4-b303-d0d82c5a5400", "name": "network-vif-plugged", "status": "completed", "tag": "8df13260-c81f-4a37-939e-ba952ce1f3f8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:23.070143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-51e6e7f7-d9b4-4be3-97c9-d6464e2f5b43 req-4cfbd292-b1f5-4d0d-891b-aebcc6ada865 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.070626 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-51e6e7f7-d9b4-4be3-97c9-d6464e2f5b43 req-4cfbd292-b1f5-4d0d-891b-aebcc6ada865 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.071057 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-51e6e7f7-d9b4-4be3-97c9-d6464e2f5b43 req-4cfbd292-b1f5-4d0d-891b-aebcc6ada865 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.077497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:23.078353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] [instance: 8da49ff6-e0f1-4367-8335-31341a3534d1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:23.083125 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-51e6e7f7-d9b4-4be3-97c9-d6464e2f5b43 req-4cfbd292-b1f5-4d0d-891b-aebcc6ada865 service nova] Creating event network-vif-plugged:8df13260-c81f-4a37-939e-ba952ce1f3f8 for instance 1665449d-cc36-47d4-b303-d0d82c5a5400 on hv-cinder-83124 Sep 09 21:16:23.085231 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.085803 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.086314 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.087254 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.087792 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.088173 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-51e6e7f7-d9b4-4be3-97c9-d6464e2f5b43 req-4cfbd292-b1f5-4d0d-891b-aebcc6ada865 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 Sep 09 21:16:23.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.088898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 479/955] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:16:23.104079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] HTTP exception thrown: Instance 8da49ff6-e0f1-4367-8335-31341a3534d1 could not be found. Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Request method failure captured: Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 HTTP/1.1 Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6zyuaJqTflWmwpW8aqU7VXrco83vl4ikYz_57JeUpV0y-VrynSSc_w4D3YO2mt7zLYwlvS5lde40ifw-sBfWrXvMFzsIic1JZi6XNfHcIPN4kY_5-P5GLQ12oE1gc_XhoDD0RAN_JfbnNHf3C8tyR7lQVM_k0d8ZoeTpU4-_JEu_9Y Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 684ee48934f949499a7c77d782372b53 Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-VolumesActionsTest-636753775 Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:16:23.105871 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684ee48934f949499a7c77d782372b53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684ee48934f949499a7c77d782372b53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684ee48934f949499a7c77d782372b53"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684ee48934f949499a7c77d782372b53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-VolumesActionsTest-636753775 Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 684ee48934f949499a7c77d782372b53 Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-VolumesActionsTest-636753775 Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-VolumesActionsTest-636753775-project Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 3ce5a94e8c594b8d813ab8e6d39633af Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-VolumesActionsTest-636753775-project Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 8da49ff6-e0f1-4367-8335-31341a3534d1 could not be found. Sep 09 21:16:23.107540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '8da49ff6-e0f1-4367-8335-31341a3534d1'} Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da49ff6-e0f1-4367-8335-31341a3534d1 could not be found. Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:16:23.113323 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da49ff6-e0f1-4367-8335-31341a3534d1 could not be found. Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da49ff6-e0f1-4367-8335-31341a3534d1 could not be found. Sep 09 21:16:23.114918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:23.116145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] Returning 404 to user: Instance 8da49ff6-e0f1-4367-8335-31341a3534d1 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:16:23.116145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a2a80822-bbe5-4ffa-873a-eb966baef276 tempest-VolumesActionsTest-636753775 tempest-VolumesActionsTest-636753775-project] 10.222.0.48 "GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1" status: 404 len: 111 microversion: 2.1 time: 0.034950 Sep 09 21:16:23.116145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 477/956] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:23 2022] GET /compute/v2.1/servers/8da49ff6-e0f1-4367-8335-31341a3534d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:16:23.139488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:23.140250 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:23.146987 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.147467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.147989 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.148709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.149159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.149579 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.181390 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.181866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.182399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.182885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lazy-loading 'fault' on Instance uuid 9af5f313-0ae0-4c98-8823-c398127b8fd1 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:16:23.228214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ef96f764244e5893f16a74d4169edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f70ceb84fc40fbb499b6a80bc5c13b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:23.239705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-108c5607-4baa-4c96-b9d4-7d80310ac727 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 200 len: 1327 microversion: 2.1 time: 0.104619 Sep 09 21:16:23.248362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 480/957] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:23 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:23.322330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-bd1e708d-62a6-4484-a595-3c76fa6cdded req-52a5872c-0986-4fed-a009-c7ff535b273d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af5f313-0ae0-4c98-8823-c398127b8fd1", "name": "network-vif-deleted", "tag": "0e3cc85d-c58f-404a-a9e9-c823c8cd640b"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:23.333387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bd1e708d-62a6-4484-a595-3c76fa6cdded req-52a5872c-0986-4fed-a009-c7ff535b273d service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.333868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bd1e708d-62a6-4484-a595-3c76fa6cdded req-52a5872c-0986-4fed-a009-c7ff535b273d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.336027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bd1e708d-62a6-4484-a595-3c76fa6cdded req-52a5872c-0986-4fed-a009-c7ff535b273d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.348226 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-bd1e708d-62a6-4484-a595-3c76fa6cdded req-52a5872c-0986-4fed-a009-c7ff535b273d service nova] Creating event network-vif-deleted:0e3cc85d-c58f-404a-a9e9-c823c8cd640b for instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 on hv-cinder-83124 Sep 09 21:16:23.353777 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-bd1e708d-62a6-4484-a595-3c76fa6cdded req-52a5872c-0986-4fed-a009-c7ff535b273d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035033 Sep 09 21:16:23.354377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 478/958] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:16:23.698955 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:23.699566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:23.706399 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.706886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.707313 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.708018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:23.708500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:23.708919 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:23.866968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:23.875771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a2bceac6-8044-4c52-b6d0-d5132d682ac5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.180328 Sep 09 21:16:23.876450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 481/959] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:23 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:24.265608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:24.266941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:24.273058 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:24.273577 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:24.274009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:24.274700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:24.275148 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:24.275568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:24.289656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] HTTP exception thrown: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Request method failure captured: Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 HTTP/1.1 Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qfPpaR9jo0WH84ZTs4mUYrHQ4k_dTZDGHPEBXpbYtWHcgdSJinUsp7gazN8W-fHE43Ap2GIsLANGhfsPAyS6DPFhFkeTj-qr0z1WDYf1u6x6a8e38kCEhzpItbXXFY77JXxXZJlO-0v9BH5oGi8T-haNNEpIeh1jxupV4QJxto4nc Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:16:24.291294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: e3ef96f764244e5893f16a74d4169edb Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:24.292931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '9af5f313-0ae0-4c98-8823-c398127b8fd1'} Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:16:24.293893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:24.295189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:24.296416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Returning 404 to user: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:16:24.296416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3b7ca1b2-3310-401d-bd43-47d0fe472877 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 404 len: 111 microversion: 2.1 time: 0.031791 Sep 09 21:16:24.296416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 479/960] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:24 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:16:24.301754 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c8322672-a2ef-4024-81ee-78110f1ee2e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '.version_select at 0x7fa1d09d8e50>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:24.390735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c8322672-a2ef-4024-81ee-78110f1ee2e2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262106309" status: 202 len: 0 microversion: 2.1 time: 0.092735 Sep 09 21:16:24.391725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 482/961] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Sep 9 21:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262106309 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:16:24.899276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:24.899904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:24.905780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:24.906265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:24.906733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:24.907429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:24.907881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:24.908329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:25.045023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:25.053421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-93d64f85-fa2f-4793-8a95-35c4d2b7c580 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.158022 Sep 09 21:16:25.053973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 480/962] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:24 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:26.079290 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:26.079899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:26.087419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:26.087899 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:26.088357 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:26.089055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:26.089492 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:26.089911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:26.217025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:26.224642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f55fd9ca-0f9d-47f1-920b-e652c113a64e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.149795 Sep 09 21:16:26.225191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 483/963] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:26 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:27.246603 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:27.247208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:27.249700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:27.254920 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:27.255404 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:27.255837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:27.256549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:27.257001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:27.257423 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:27.261392 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:27.383807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:27.391855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-99b0c882-57c0-4a83-bdc2-506cc710a92c tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.149062 Sep 09 21:16:27.392457 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 481/964] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:27 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:28.415157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:28.415764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:28.422211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:28.422688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:28.423118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:28.423797 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:28.424271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:28.424689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:28.557153 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:28.565123 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ddd1f5c0-ead3-4fc4-b547-b32ac16bbd99 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1262 microversion: 2.1 time: 0.153799 Sep 09 21:16:28.565687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 484/965] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:28 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:29.590008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:29.590628 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:29.598767 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:29.599272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:29.599898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:29.600634 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:29.601094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:29.601525 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:29.733966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:29.742399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9cf45f40-162b-4f6f-89e9-485b0d455afb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1448 microversion: 2.1 time: 0.157383 Sep 09 21:16:29.742961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 482/966] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:29 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:29.765073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:29.765692 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:29.772028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:29.772550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:29.772990 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:29.773683 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:29.774143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:29.774567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:30.064585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:16:30.064585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8f78b87c-8894-4924-9381-21105eb7fe07 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1448 microversion: 2.1 time: 0.152226 Sep 09 21:16:30.064585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 485/967] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:29 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:16:31.989622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:31.990160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:31.997549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:31.998589 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:31.999310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:32.000757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:32.001324 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:32.001850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:32.031494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] HTTP exception thrown: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Request method failure captured: Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 HTTP/1.1 Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qfPpaR9jo0WH84ZTs4mUYrHQ4k_dTZDGHPEBXpbYtWHcgdSJinUsp7gazN8W-fHE43Ap2GIsLANGhfsPAyS6DPFhFkeTj-qr0z1WDYf1u6x6a8e38kCEhzpItbXXFY77JXxXZJlO-0v9BH5oGi8T-haNNEpIeh1jxupV4QJxto4nc Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:16:32.034689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: e3ef96f764244e5893f16a74d4169edb Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.036993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '9af5f313-0ae0-4c98-8823-c398127b8fd1'} Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:16:32.038291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.040161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.042578 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Returning 404 to user: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:16:32.043603 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-25667ea0-b0dc-4d36-bc0d-be858dd36192 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 404 len: 111 microversion: 2.1 time: 0.057892 Sep 09 21:16:32.045062 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 483/968] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:16:31 2022] DELETE /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:16:32.054248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:32.054921 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 9af5f313-0ae0-4c98-8823-c398127b8fd1] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:32.061614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:32.064339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:32.064339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:32.064660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:32.065321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:32.065918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:32.081305 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] HTTP exception thrown: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Request method failure captured: Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 HTTP/1.1 Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qfPpaR9jo0WH84ZTs4mUYrHQ4k_dTZDGHPEBXpbYtWHcgdSJinUsp7gazN8W-fHE43Ap2GIsLANGhfsPAyS6DPFhFkeTj-qr0z1WDYf1u6x6a8e38kCEhzpItbXXFY77JXxXZJlO-0v9BH5oGi8T-haNNEpIeh1jxupV4QJxto4nc Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:16:32.084906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: e3ef96f764244e5893f16a74d4169edb Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.086477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '9af5f313-0ae0-4c98-8823-c398127b8fd1'} Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:16:32.087889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. Sep 09 21:16:32.089429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:32.090710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Returning 404 to user: Instance 9af5f313-0ae0-4c98-8823-c398127b8fd1 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:16:32.090710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c8113902-5bb6-473f-a7b4-42050d322445 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1" status: 404 len: 111 microversion: 2.1 time: 0.034751 Sep 09 21:16:32.090710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 486/969] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:32 2022] GET /compute/v2.1/servers/9af5f313-0ae0-4c98-8823-c398127b8fd1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:16:32.180239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-bc37bf54-120d-44d5-9785-4bbe9508e3fc req-f1e8e5a2-6834-4957-bb72-1f414818081e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1665449d-cc36-47d4-b303-d0d82c5a5400", "tag": "8df13260-c81f-4a37-939e-ba952ce1f3f8"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:16:32.190385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bc37bf54-120d-44d5-9785-4bbe9508e3fc req-f1e8e5a2-6834-4957-bb72-1f414818081e service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:32.191243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bc37bf54-120d-44d5-9785-4bbe9508e3fc req-f1e8e5a2-6834-4957-bb72-1f414818081e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:32.191683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-bc37bf54-120d-44d5-9785-4bbe9508e3fc req-f1e8e5a2-6834-4957-bb72-1f414818081e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:32.203964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-bc37bf54-120d-44d5-9785-4bbe9508e3fc req-f1e8e5a2-6834-4957-bb72-1f414818081e service nova] Creating event network-changed:8df13260-c81f-4a37-939e-ba952ce1f3f8 for instance 1665449d-cc36-47d4-b303-d0d82c5a5400 on hv-cinder-83124 Sep 09 21:16:32.209860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-bc37bf54-120d-44d5-9785-4bbe9508e3fc req-f1e8e5a2-6834-4957-bb72-1f414818081e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033478 Sep 09 21:16:32.210391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 484/970] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:16:33.434501 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:33.435239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:33.447435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:33.450001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:33.450781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:33.452680 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:33.454535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:33.455070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:33.485360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] HTTP exception thrown: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Request method failure captured: Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca HTTP/1.1 Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qfPpaR9jo0WH84ZTs4mUYrHQ4k_dTZDGHPEBXpbYtWHcgdSJinUsp7gazN8W-fHE43Ap2GIsLANGhfsPAyS6DPFhFkeTj-qr0z1WDYf1u6x6a8e38kCEhzpItbXXFY77JXxXZJlO-0v9BH5oGi8T-haNNEpIeh1jxupV4QJxto4nc Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:16:33.488335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: e3ef96f764244e5893f16a74d4169edb Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.490009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '0f14bf7b-dd56-44e0-bd6a-cd546c3956ca'} Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:16:33.490981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.493029 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.495602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Returning 404 to user: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:16:33.502687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-64950921-882b-497a-ba02-e7702e1a6ea2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 404 len: 111 microversion: 2.1 time: 0.068624 Sep 09 21:16:33.502687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 487/971] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:16:33 2022] DELETE /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:16:33.510004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:33.511390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] [instance: 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:33.522447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:33.524288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:33.524288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:33.524288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:33.529006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:33.531104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:33.547359 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] HTTP exception thrown: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Request method failure captured: Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca HTTP/1.1 Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qfPpaR9jo0WH84ZTs4mUYrHQ4k_dTZDGHPEBXpbYtWHcgdSJinUsp7gazN8W-fHE43Ap2GIsLANGhfsPAyS6DPFhFkeTj-qr0z1WDYf1u6x6a8e38kCEhzpItbXXFY77JXxXZJlO-0v9BH5oGi8T-haNNEpIeh1jxupV4QJxto4nc Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:16:33.555666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d9f70ceb84fc40fbb499b6a80bc5c13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: d9f70ceb84fc40fbb499b6a80bc5c13b Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1194879069 Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: e3ef96f764244e5893f16a74d4169edb Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeTestJSON-1194879069-project Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.557184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '0f14bf7b-dd56-44e0-bd6a-cd546c3956ca'} Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:16:33.557979 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. Sep 09 21:16:33.559957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:16:33.561439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] Returning 404 to user: Instance 0f14bf7b-dd56-44e0-bd6a-cd546c3956ca could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:16:33.561439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-72bc361a-93bc-4511-aa95-77001dcbb8d2 tempest-AttachVolumeTestJSON-1194879069 tempest-AttachVolumeTestJSON-1194879069-project] 10.222.0.48 "GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca" status: 404 len: 111 microversion: 2.1 time: 0.052079 Sep 09 21:16:33.561439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 485/972] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:16:33 2022] GET /compute/v2.1/servers/0f14bf7b-dd56-44e0-bd6a-cd546c3956ca => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:16:59.702174 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:59.704344 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:59.706782 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:59.707949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=75 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:59.712595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:59.713076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:59.713510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:59.714196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:59.714644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:59.715064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:59.744129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b39fe712-efed-4fe8-880a-83f4afad84b1 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046019 Sep 09 21:16:59.744810 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 488/973] 10.222.0.48 () {60 vars in 1343 bytes} [Fri Sep 9 21:16:59 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:16:59.807236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:16:59.807752 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:16:59.809866 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=9 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:59.810524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=16 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:16:59.815162 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:59.815650 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:59.816771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:59.817488 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:16:59.817945 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:16:59.818386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:16:59.843766 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:17:00.167412 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fa164c2b-17e2-4cda-953c-1df038de1a61 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 204 len: 0 microversion: 2.20 time: 0.363919 Sep 09 21:17:00.168007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 486/974] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Sep 9 21:16:59 2022] DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 21:17:00.177223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:00.177868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:00.185342 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:00.185829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:00.186292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:00.187240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:00.187703 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:00.188157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:00.319869 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:00.328006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:00.329567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:00.331083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f82912de-1c80-48e8-9bd1-fba9c83d1c38 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.158290 Sep 09 21:17:00.331710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 489/975] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:00 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:17:01.358948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:01.359653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:01.366543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:01.367030 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:01.367471 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:01.368198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:01.368654 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:01.369081 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:01.498204 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:01.506415 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:01.507875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:01.509071 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ce19f9b1-ed5e-43d4-aa7f-2f451b924b4e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.154474 Sep 09 21:17:01.509633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 487/976] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:01 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:17:02.534958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:02.535605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:02.542616 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:02.543097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:02.543534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:02.544248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:02.544706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:02.545124 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:02.757082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:02.765217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:02.766676 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:02.767844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7b93e01f-9120-4329-a0e7-5dc6b77e4630 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1722 microversion: 2.20 time: 0.236897 Sep 09 21:17:02.768427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 490/977] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:02 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:17:03.208932 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-2e73fb53-cc71-4718-bf43-674a36f9591e req-61632e0e-4669-4459-806b-fedc4f44be69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c43ab2f3-86c6-4173-8480-56fbe0061814", "name": "network-vif-deleted", "tag": "5525d6e1-078c-4b89-9938-60eb30d1d6b8"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:17:03.224431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-2e73fb53-cc71-4718-bf43-674a36f9591e req-61632e0e-4669-4459-806b-fedc4f44be69 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:03.227347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-2e73fb53-cc71-4718-bf43-674a36f9591e req-61632e0e-4669-4459-806b-fedc4f44be69 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:03.227347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-2e73fb53-cc71-4718-bf43-674a36f9591e req-61632e0e-4669-4459-806b-fedc4f44be69 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:03.236361 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-2e73fb53-cc71-4718-bf43-674a36f9591e req-61632e0e-4669-4459-806b-fedc4f44be69 service nova] Creating event network-vif-deleted:5525d6e1-078c-4b89-9938-60eb30d1d6b8 for instance c43ab2f3-86c6-4173-8480-56fbe0061814 on hv-cinder-83124 Sep 09 21:17:03.241881 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-2e73fb53-cc71-4718-bf43-674a36f9591e req-61632e0e-4669-4459-806b-fedc4f44be69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036904 Sep 09 21:17:03.242529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 488/978] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:17:03.794544 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:03.795308 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:03.801837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:03.802324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:03.802763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:03.803468 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:03.803924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:03.804419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:03.836701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:03.837186 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:03.837617 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:03.838062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lazy-loading 'fault' on Instance uuid c43ab2f3-86c6-4173-8480-56fbe0061814 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:17:03.877855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:03.887091 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:03.888678 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710e49db188845bbae5a183c6657e07f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620d0a2c4566408aa134f2a8ac7d91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:03.889961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c836f27e-1fd3-478e-97b8-85d50fc328b4 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 200 len: 1370 microversion: 2.20 time: 0.099480 Sep 09 21:17:03.890601 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 491/979] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:03 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 21:17:04.917117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:04.917811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:04.923874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:04.924391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:04.924828 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:04.925512 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:04.925966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:04.926424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:04.939685 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] HTTP exception thrown: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Request method failure captured: Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 HTTP/1.1 Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qd63DX4VBTrtw9I4V_Zwz7NvlcN5aBoQrLtpRkPfhuxagC84Im8w3b2OsWEh8xeG4il6laWD9uYct36GZ3MDTdOs8YJs1MD0AukXVgO8_fDKGrj7OfRqFicjpLddumfmnRD5WwNmqV724X3eeo2MZp3tDeGOP79L8KT-JZPhdea1k Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:17:04.941315 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 710e49db188845bbae5a183c6657e07f Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:04.943674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'c43ab2f3-86c6-4173-8480-56fbe0061814'} Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:17:04.944811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:04.946363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:04.947888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Returning 404 to user: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:17:04.947888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3b51e13c-4ebf-4e54-9b62-000760b6d8b9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 404 len: 111 microversion: 2.20 time: 0.030987 Sep 09 21:17:04.947888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 489/980] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:04 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:17:04.952082 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2fe06328-d012-4490-ba35-f25c4428b46b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '.version_select at 0x7fa1d0a74310>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:05.029952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2fe06328-d012-4490-ba35-f25c4428b46b tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445231110" status: 204 len: 0 microversion: 2.20 time: 0.081617 Sep 09 21:17:05.030661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 492/981] 10.222.0.48 () {60 vars in 1259 bytes} [Fri Sep 9 21:17:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445231110 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 21:17:07.045849 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:07.046348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:07.052748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:07.062700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:07.062700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:07.062700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:07.062700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:07.063105 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:07.069421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] HTTP exception thrown: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Request method failure captured: Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 HTTP/1.1 Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qd63DX4VBTrtw9I4V_Zwz7NvlcN5aBoQrLtpRkPfhuxagC84Im8w3b2OsWEh8xeG4il6laWD9uYct36GZ3MDTdOs8YJs1MD0AukXVgO8_fDKGrj7OfRqFicjpLddumfmnRD5WwNmqV724X3eeo2MZp3tDeGOP79L8KT-JZPhdea1k Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:17:07.070961 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 710e49db188845bbae5a183c6657e07f Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.072651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'c43ab2f3-86c6-4173-8480-56fbe0061814'} Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:17:07.073529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.074883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.076427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Returning 404 to user: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:17:07.076427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-92061301-4b15-4447-889c-e2b54429b45c tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 404 len: 111 microversion: 2.20 time: 0.030364 Sep 09 21:17:07.076427 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 490/982] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Sep 9 21:17:07 2022] DELETE /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:17:07.082376 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:07.083509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: c43ab2f3-86c6-4173-8480-56fbe0061814] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:07.090130 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:07.090606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:07.091089 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:07.091772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:07.092247 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:07.092664 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:07.106215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] HTTP exception thrown: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Request method failure captured: Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 HTTP/1.1 Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qd63DX4VBTrtw9I4V_Zwz7NvlcN5aBoQrLtpRkPfhuxagC84Im8w3b2OsWEh8xeG4il6laWD9uYct36GZ3MDTdOs8YJs1MD0AukXVgO8_fDKGrj7OfRqFicjpLddumfmnRD5WwNmqV724X3eeo2MZp3tDeGOP79L8KT-JZPhdea1k Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:17:07.108382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 710e49db188845bbae5a183c6657e07f Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.110073 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'c43ab2f3-86c6-4173-8480-56fbe0061814'} Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:17:07.110939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. Sep 09 21:17:07.112452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:07.113946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Returning 404 to user: Instance c43ab2f3-86c6-4173-8480-56fbe0061814 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:17:07.113946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-97b6d9b0-fa3c-45a0-8def-d6d880b164f9 tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814" status: 404 len: 111 microversion: 2.20 time: 0.031897 Sep 09 21:17:07.113946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 493/983] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:07 2022] GET /compute/v2.1/servers/c43ab2f3-86c6-4173-8480-56fbe0061814 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:17:08.426801 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:08.427309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:08.433622 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:08.434109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:08.434548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:08.435238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:08.435696 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:08.436152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:08.449921 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] HTTP exception thrown: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Request method failure captured: Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 HTTP/1.1 Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6qd63DX4VBTrtw9I4V_Zwz7NvlcN5aBoQrLtpRkPfhuxagC84Im8w3b2OsWEh8xeG4il6laWD9uYct36GZ3MDTdOs8YJs1MD0AukXVgO8_fDKGrj7OfRqFicjpLddumfmnRD5WwNmqV724X3eeo2MZp3tDeGOP79L8KT-JZPhdea1k Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:17:08.451465 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 710e49db188845bbae5a183c6657e07f Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.453318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'd1900205-eef2-494e-b59c-a7ea601f4835'} Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:17:08.454214 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.455658 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.460260 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Returning 404 to user: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:17:08.460260 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-00b9d90a-aba9-463c-b6cf-5f23c4ffff8f tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 404 len: 111 microversion: 2.20 time: 0.029998 Sep 09 21:17:08.460260 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 491/984] 10.222.0.48 () {60 vars in 1280 bytes} [Fri Sep 9 21:17:08 2022] DELETE /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:17:08.466222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:08.466839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] [instance: d1900205-eef2-494e-b59c-a7ea601f4835] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:08.473161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:08.473638 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:08.474071 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:08.474759 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:08.475210 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:08.475629 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:08.488525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] HTTP exception thrown: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Request method failure captured: Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 HTTP/1.1 Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6qd63DX4VBTrtw9I4V_Zwz7NvlcN5aBoQrLtpRkPfhuxagC84Im8w3b2OsWEh8xeG4il6laWD9uYct36GZ3MDTdOs8YJs1MD0AukXVgO8_fDKGrj7OfRqFicjpLddumfmnRD5WwNmqV724X3eeo2MZp3tDeGOP79L8KT-JZPhdea1k Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:17:08.490028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_620d0a2c4566408aa134f2a8ac7d91ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 620d0a2c4566408aa134f2a8ac7d91ee Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1032369565 Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 710e49db188845bbae5a183c6657e07f Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1032369565-project Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.491642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'd1900205-eef2-494e-b59c-a7ea601f4835'} Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:17:08.495753 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. Sep 09 21:17:08.497303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:17:08.498703 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] Returning 404 to user: Instance d1900205-eef2-494e-b59c-a7ea601f4835 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:17:08.498703 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9dcde446-45af-4ee3-b665-b3b6bbfeb39e tempest-AttachVolumeShelveTestJSON-1032369565 tempest-AttachVolumeShelveTestJSON-1032369565-project] 10.222.0.48 "GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835" status: 404 len: 111 microversion: 2.20 time: 0.029065 Sep 09 21:17:08.498703 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 494/985] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Sep 9 21:17:08 2022] GET /compute/v2.1/servers/d1900205-eef2-494e-b59c-a7ea601f4835 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:17:19.110642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:19.111041 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:19.230873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5077e0c0-98ed-4451-8129-7985580b2516 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: .version_select at 0x7fa1d0a04670>, body: {"keypair": {"name": "tempest-keypair-985352337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFNdtptJVWnc4K4vbfP4s0XCYqLylDF7Hhm7NNj4fWr0Lp33uG5+KHwcZrVQX+KSyMksUgRxhEeqtgv7XYmai2ZUtRr1JhsFALmDLrfq3kroS98Im6DEcbSxDoq4uKtbw=="}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:17:19.246811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-5077e0c0-98ed-4451-8129-7985580b2516 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:17:19.251114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-5077e0c0-98ed-4451-8129-7985580b2516 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:17:19.361098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5077e0c0-98ed-4451-8129-7985580b2516 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256429 Sep 09 21:17:19.361712 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 492/986] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:17:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:17:21.683316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-418248339", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0801b011-6de8-408c-b234-30930e8ba97f"}], "security_groups": [{"name": "tempest-securitygroup--884047040"}], "key_name": "tempest-keypair-985352337", "user_data": "}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:17:21.691903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:21.693158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=30 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:21.788056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] validate_networks() for [('0801b011-6de8-408c-b234-30930e8ba97f', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:17:22.171855 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:17:22.172319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:17:22.172831 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:17:22.173432 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:17:22.181963 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:17:22.184531 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:22.185225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:22.185668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:22.186404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:22.187116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:22.187733 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:22.205801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:17:22.210978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:17:22.224959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:17:22.227886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:17:22.352890 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0e0f4d73-88b0-40be-aa71-c9dc4d16d0d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.673756 Sep 09 21:17:22.353695 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 495/987] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:17:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:17:22.365715 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f99f08d5-3b32-41f4-9856-f32e1e7eb635 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:22.366506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f99f08d5-3b32-41f4-9856-f32e1e7eb635 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:22.426249 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f99f08d5-3b32-41f4-9856-f32e1e7eb635 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:22.436276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f99f08d5-3b32-41f4-9856-f32e1e7eb635 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1240 microversion: 2.1 time: 0.075240 Sep 09 21:17:22.436963 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 493/988] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:22 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:17:23.464477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:23.465088 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:23.471845 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:23.472356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:23.472788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:23.473997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:23.474446 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:23.474864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:23.540967 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:23.548605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-748a941e-0a6f-46a3-9682-996ab44a5993 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1244 microversion: 2.1 time: 0.088895 Sep 09 21:17:23.549161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 496/989] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:23 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:24.572402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:24.573045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:24.580486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:24.581232 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:24.582151 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:24.582919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:24.583370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:24.583899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:24.681574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:24.689682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ea1eeb7f-7305-4c00-bf18-b985aa297ce8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1300 microversion: 2.1 time: 0.122431 Sep 09 21:17:24.690679 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 494/990] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:24 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:25.718066 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:25.718757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:25.725389 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:25.725879 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:25.726323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:25.727034 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:25.727488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:25.727914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:25.973514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:25.985556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8a536b59-1a46-4045-bb70-a444e4ac6c62 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.271385 Sep 09 21:17:25.986158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 497/991] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:25 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:26.519475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-ec6042c4-732c-4df4-b6cd-cd87be78a7f5 req-285b0011-ac35-4cd5-b5b2-ab0c8cbad3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1c1de6-e162-4413-8fae-d5ccbdfac60e", "tag": "16ea8775-e00c-4e03-b05f-871b94eb79ad"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:17:26.528840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-ec6042c4-732c-4df4-b6cd-cd87be78a7f5 req-285b0011-ac35-4cd5-b5b2-ab0c8cbad3e8 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:26.529318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-ec6042c4-732c-4df4-b6cd-cd87be78a7f5 req-285b0011-ac35-4cd5-b5b2-ab0c8cbad3e8 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:26.529745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-ec6042c4-732c-4df4-b6cd-cd87be78a7f5 req-285b0011-ac35-4cd5-b5b2-ab0c8cbad3e8 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:26.541030 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-ec6042c4-732c-4df4-b6cd-cd87be78a7f5 req-285b0011-ac35-4cd5-b5b2-ab0c8cbad3e8 service nova] Creating event network-changed:16ea8775-e00c-4e03-b05f-871b94eb79ad for instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e on hv-cinder-83124 Sep 09 21:17:26.545741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-ec6042c4-732c-4df4-b6cd-cd87be78a7f5 req-285b0011-ac35-4cd5-b5b2-ab0c8cbad3e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084585 Sep 09 21:17:26.546313 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 495/992] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:17:27.009577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:27.010271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:27.017089 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:27.017580 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:27.018012 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:27.018715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:27.019175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:27.019596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:27.290839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:27.298575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d79c813b-775a-49c0-a601-303eef2f3181 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.292981 Sep 09 21:17:27.299134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 498/993] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:27 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:28.322343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:28.322939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:28.329150 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:28.329633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:28.330063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:28.330744 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:28.331461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:28.331880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:28.461291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:28.468970 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0dafb105-c0e5-4c4c-a55a-9803a59aa138 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.151406 Sep 09 21:17:28.469533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 496/994] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:28 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:29.492936 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:29.493558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:29.500001 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:29.500518 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:29.500977 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:29.501701 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:29.502160 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:29.502700 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:29.627325 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:29.634962 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f534bed9-b1ea-494b-be2e-0cb6ee8361e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.146577 Sep 09 21:17:29.635519 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 499/995] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:29 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:30.657608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:30.658227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:30.665328 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:30.665806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:30.666239 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:30.666929 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:30.667381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:30.667808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:30.793797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:30.801505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fc45149e-a520-4c16-a6d9-a9b5a3786643 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.147631 Sep 09 21:17:30.801911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 497/996] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:30 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:31.825011 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:31.825530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:31.832035 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:31.832542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:31.832967 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:31.833663 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:31.834096 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:31.834513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:31.963727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:31.971340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-69c782c6-adb2-41ee-b119-8446a006b429 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.150313 Sep 09 21:17:31.971905 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 500/997] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:31 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:32.994731 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:32.995347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:32.997872 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:33.003985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:33.003985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:33.003985 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:33.013055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:33.013055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:33.013055 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:33.136668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:33.144205 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-19999e6c-8d76-4023-99b9-ea4a564657bc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.153346 Sep 09 21:17:33.145379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 498/998] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:32 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:34.167333 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:34.168039 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:34.169920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:34.170735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:17:34.176497 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:34.178307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:34.178307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:34.178307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:34.178627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:34.178998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:34.338430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:34.345984 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7543ea09-f645-4fb2-ae03-1b7347653fad tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.182629 Sep 09 21:17:34.346549 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 501/999] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:34 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:35.369643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:35.370253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:35.376668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:35.377163 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:35.377591 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:35.378275 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:35.378720 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:35.379137 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:35.511200 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:35.522676 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e5aaac28-e31d-4252-84fa-dbb7c0dac099 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.156796 Sep 09 21:17:35.523196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 499/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:35 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:35.915314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-2583db1d-0627-48a1-8aeb-ee8d7abcba28 req-5fe0f2f6-b588-470a-92e4-c0c7de5262d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1c1de6-e162-4413-8fae-d5ccbdfac60e", "name": "network-vif-plugged", "status": "completed", "tag": "16ea8775-e00c-4e03-b05f-871b94eb79ad"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:17:35.925312 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-2583db1d-0627-48a1-8aeb-ee8d7abcba28 req-5fe0f2f6-b588-470a-92e4-c0c7de5262d1 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:35.926330 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-2583db1d-0627-48a1-8aeb-ee8d7abcba28 req-5fe0f2f6-b588-470a-92e4-c0c7de5262d1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:35.926762 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-2583db1d-0627-48a1-8aeb-ee8d7abcba28 req-5fe0f2f6-b588-470a-92e4-c0c7de5262d1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:35.937525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-2583db1d-0627-48a1-8aeb-ee8d7abcba28 req-5fe0f2f6-b588-470a-92e4-c0c7de5262d1 service nova] Creating event network-vif-plugged:16ea8775-e00c-4e03-b05f-871b94eb79ad for instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e on hv-cinder-83124 Sep 09 21:17:35.943212 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-2583db1d-0627-48a1-8aeb-ee8d7abcba28 req-5fe0f2f6-b588-470a-92e4-c0c7de5262d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031834 Sep 09 21:17:35.945004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 502/1001] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:17:36.546632 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:36.547345 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:36.553602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:36.554147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:36.554583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:36.555270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:36.555718 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:36.556165 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:36.719200 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:36.727965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-abf42836-4aa8-4312-a06b-8032f09f3607 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.185161 Sep 09 21:17:36.728627 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 500/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:36 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:37.750722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:37.751447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:37.757640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:37.758128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:37.758607 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:37.759304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:37.759758 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:37.760246 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:37.941888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:37.947238 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-58dbdf0f-0c1c-48ea-9e78-19161aeda6d1 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1365 microversion: 2.1 time: 0.201276 Sep 09 21:17:37.947837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 503/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:37 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:38.971071 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:38.971683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:38.978379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:38.978908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:38.979341 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:38.980155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:38.980611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:38.981028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:39.124738 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:17:39.132974 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-13b687d6-3355-4897-a848-80dc20c0f08e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1555 microversion: 2.1 time: 0.165931 Sep 09 21:17:39.133822 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 501/1004] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:17:38 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:17:39.158450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:17:39.159022 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:17:39.165744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:39.166226 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:39.166660 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:39.167356 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:39.168052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:39.168833 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:39.254373 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ecae30d0-b496-44af-881e-20752af81748 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099704 Sep 09 21:17:39.254965 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 504/1005] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:17:39 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:17:40.689529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-a73d68e6-d3c9-4eb9-8096-c12364cab75b req-dcb5096b-58a5-40bd-a62f-dc5421afeee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1c1de6-e162-4413-8fae-d5ccbdfac60e", "tag": "16ea8775-e00c-4e03-b05f-871b94eb79ad"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:17:40.700255 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-a73d68e6-d3c9-4eb9-8096-c12364cab75b req-dcb5096b-58a5-40bd-a62f-dc5421afeee3 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:17:40.701035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-a73d68e6-d3c9-4eb9-8096-c12364cab75b req-dcb5096b-58a5-40bd-a62f-dc5421afeee3 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:17:40.701466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-a73d68e6-d3c9-4eb9-8096-c12364cab75b req-dcb5096b-58a5-40bd-a62f-dc5421afeee3 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:17:40.714429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-a73d68e6-d3c9-4eb9-8096-c12364cab75b req-dcb5096b-58a5-40bd-a62f-dc5421afeee3 service nova] Creating event network-changed:16ea8775-e00c-4e03-b05f-871b94eb79ad for instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e on hv-cinder-83124 Sep 09 21:17:40.719856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-a73d68e6-d3c9-4eb9-8096-c12364cab75b req-dcb5096b-58a5-40bd-a62f-dc5421afeee3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240859 Sep 09 21:17:40.722238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 502/1006] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:22.428525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.429274 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=50 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.433149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4abc5502-3c6d-4b99-97a4-c33587c015df tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Action: 'create', calling method: .version_select at 0x7fa1d09d5f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-627116112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCT6CviD5HZkmtu680595b3Qah2eNGyX43L9qdK5fNz7E2ESQsB1bYXY2DwzXDx5xbONXMOwERPjBP8w/YFZIukawKNzvsyzBXS7BEVCjh6IMMImYM6aonlpuWsvScZjg=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:22.448378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-4abc5502-3c6d-4b99-97a4-c33587c015df tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Getting quotas for project a1261e5e82414293b96ce77482498a89. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:18:22.452035 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-4abc5502-3c6d-4b99-97a4-c33587c015df tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Getting quotas for user fa04bcfffac2473baad2953f1c64eb95 and project a1261e5e82414293b96ce77482498a89. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:18:22.542862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4abc5502-3c6d-4b99-97a4-c33587c015df tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.116615 Sep 09 21:18:22.543452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 505/1007] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:18:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:22.592566 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 09 21:18:22.593787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.594514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=46 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:22.598602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-287729164", "imageRef": "beaa0770-c355-488b-a737-c215f6a15534", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-627116112", "networks": [{"uuid": "f5645c89-16d7-437f-b45e-e731d5e20f92"}]}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:22.649870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] validate_networks() for [('f5645c89-16d7-437f-b45e-e731d5e20f92', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:18:23.108935 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:18:23.109360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:18:23.109865 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:18:23.110276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:18:23.110689 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:18:23.120052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:23.120558 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:23.120992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:23.121728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:23.122184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:23.122609 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:23.139338 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Getting quotas for project a1261e5e82414293b96ce77482498a89. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:18:23.143268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Getting quotas for user fa04bcfffac2473baad2953f1c64eb95 and project a1261e5e82414293b96ce77482498a89. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:18:23.154009 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:18:23.156337 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='beaa0770-c355-488b-a737-c215f6a15534',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:18:23.275202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e49f8e89-a9e7-4228-b09d-127d3d7a283c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684516 Sep 09 21:18:23.276135 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 503/1008] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:18:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:18:23.288168 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-bcbab14a-a4d3-4c4b-8c82-22964dd5b20e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:23.288804 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-bcbab14a-a4d3-4c4b-8c82-22964dd5b20e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:23.343813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-bcbab14a-a4d3-4c4b-8c82-22964dd5b20e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:23.352007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-bcbab14a-a4d3-4c4b-8c82-22964dd5b20e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1257 microversion: 2.1 time: 0.068975 Sep 09 21:18:23.352587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 506/1009] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:23 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:24.375304 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-767ccc87-4457-47c6-8f43-a0f31275cd42 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:24.375849 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-767ccc87-4457-47c6-8f43-a0f31275cd42 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:24.428664 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-767ccc87-4457-47c6-8f43-a0f31275cd42 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:24.435537 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-767ccc87-4457-47c6-8f43-a0f31275cd42 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1257 microversion: 2.1 time: 0.064628 Sep 09 21:18:24.436138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 504/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:24 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:25.458126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:25.462324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:25.465958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:25.466440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:25.466873 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:25.467570 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:25.468019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:25.468463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:25.532323 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:25.540669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fe67d51d-3544-4e29-9189-a9031099eb67 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1309 microversion: 2.1 time: 0.086741 Sep 09 21:18:25.541225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 507/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:25 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:26.569454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:26.572144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:26.582568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:26.583210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:26.583770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:26.585458 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:26.586453 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:26.587228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:26.760532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:26.769948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7f3a6029-c094-4dab-85e6-814cbc4d07f8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.207946 Sep 09 21:18:26.770905 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 505/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:26 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:27.794650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:27.795252 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:27.801951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:27.802442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:27.802908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:27.803891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:27.804595 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:27.805023 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:27.938774 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:27.946961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6c5d78ad-cda9-4336-9dbc-5dfb924d4ae9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.156178 Sep 09 21:18:27.947517 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 508/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:27 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:28.970145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:28.970891 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:28.978672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:28.979186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:28.979624 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:28.980362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:28.980816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:28.981262 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:29.111749 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:29.119393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3ab979d9-ffce-42e2-88cc-60af900e1bca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.153298 Sep 09 21:18:29.119954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 506/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:28 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:30.142735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:30.143352 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:30.150406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:30.150892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:30.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:30.152021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:30.152620 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:30.153042 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:30.286299 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:30.294139 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d3086688-34ca-42d3-8a8e-4ae02786043c tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.155270 Sep 09 21:18:30.294949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 509/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:30 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:31.377723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:31.378332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:31.385556 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:31.386052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:31.386584 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:31.387303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:31.387756 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:31.388219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:31.521769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:31.529592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c8c28063-22c5-42f4-8ffe-513997c7acab tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.155882 Sep 09 21:18:31.530353 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 507/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:31 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:32.554621 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:32.557377 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:32.562437 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:32.563113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:32.563672 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:32.564688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:32.565292 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:32.565973 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:32.708591 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:32.726657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ad03a913-7074-44d5-ac64-c007ed4f2879 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.167535 Sep 09 21:18:32.726657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 510/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:32 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:33.739325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:33.740052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:33.742318 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:33.747273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:33.747794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:33.748275 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:33.749090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:33.749551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:33.749980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:33.892621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:33.900424 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-420fced2-af6e-41e8-97d8-ad2cd8edc442 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.165437 Sep 09 21:18:33.901216 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 508/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:33 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:34.925159 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:34.925814 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:34.927585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:34.932834 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:34.933327 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:34.933745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:34.934438 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:34.934886 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:34.935300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:35.071371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:35.079058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-aaedfcd7-5f6d-4b1f-af12-1e5108f410e4 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.157734 Sep 09 21:18:35.079611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 511/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:34 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:36.102430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:36.103043 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:36.104978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=8 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:36.115035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:36.115797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:36.116265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:36.116962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:36.117625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:36.118103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:36.248448 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:36.256475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ab649f60-82f9-4111-b807-4f74212d5c0e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.157871 Sep 09 21:18:36.257036 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 509/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:36 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:37.279520 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:37.280126 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:37.286482 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:37.286959 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:37.287392 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:37.288093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:37.288553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:37.288974 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:37.415510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:37.422986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-29a5a10f-0bf4-4a25-9ff5-fafc4dc757fc tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.147401 Sep 09 21:18:37.423539 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 512/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:37 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:38.445826 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:38.446447 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:38.452996 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:38.453485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:38.453925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:38.454614 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:38.455064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:38.455491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:38.580702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:38.588489 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-509be9c3-6e89-4951-b682-9e359733f100 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.146633 Sep 09 21:18:38.589052 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 510/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:38 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:39.610770 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:39.611353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:39.617939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:39.621119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:39.621119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:39.621119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:39.621119 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:39.621652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:39.862009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:39.870165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4a70c529-1221-4c26-aa83-d80ff69ae8ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.263146 Sep 09 21:18:39.884513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 513/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:39 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:40.574464 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-47543d6c-869a-4fd4-82bf-645d31600317 req-702112af-d6bf-4cce-804d-647e04c8256e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:40.584812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-47543d6c-869a-4fd4-82bf-645d31600317 req-702112af-d6bf-4cce-804d-647e04c8256e service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:40.585289 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-47543d6c-869a-4fd4-82bf-645d31600317 req-702112af-d6bf-4cce-804d-647e04c8256e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:40.585723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-47543d6c-869a-4fd4-82bf-645d31600317 req-702112af-d6bf-4cce-804d-647e04c8256e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:40.596902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-47543d6c-869a-4fd4-82bf-645d31600317 req-702112af-d6bf-4cce-804d-647e04c8256e service nova] Creating event network-changed:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:18:40.602548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-47543d6c-869a-4fd4-82bf-645d31600317 req-702112af-d6bf-4cce-804d-647e04c8256e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031832 Sep 09 21:18:40.607079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 511/1024] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:40.894557 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:40.895847 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:40.902297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:40.902779 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:40.903211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:40.903908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:40.904390 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:40.904864 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:41.113118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:41.120673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a2c42537-961c-495d-8236-251a2f3cb98d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.230110 Sep 09 21:18:41.121233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 514/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:40 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:42.144233 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:42.144943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:42.151114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:42.151596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:42.152035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:42.152760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:42.153220 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:42.153647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:42.280090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:42.288266 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-415a3f0e-43b3-4f84-92cd-4b214bc38b97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.148785 Sep 09 21:18:42.288834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 512/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:42 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:43.311320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:43.311881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:43.318937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:43.319422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:43.319860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:43.320588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:43.321045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:43.321472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:43.449626 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:43.457950 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8765d046-16eb-486f-ae88-0288187332e5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.149811 Sep 09 21:18:43.458518 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 515/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:43 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:44.479937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:44.480607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:44.487035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:44.487523 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:44.487964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:44.489335 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:44.489800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:44.490230 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:44.616926 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:44.624652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a69c74f5-973f-4a22-b9dd-ea4a53a362a9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.148576 Sep 09 21:18:44.625241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 513/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:44 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:45.646772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:45.647383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:45.653786 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:45.654266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:45.654697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:45.655378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:45.655829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:45.656277 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:45.784592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:45.792668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f037835b-14a5-409d-b0cf-4e82075ba3eb tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.149827 Sep 09 21:18:45.793233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 516/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:45 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:46.354799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-5fdc6d4b-ebc4-4911-9ed9-578cd832f2d1 req-fa48985f-4197-4f31-83d2-cbed50f6dbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "name": "network-vif-plugged", "status": "completed", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:46.364298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-5fdc6d4b-ebc4-4911-9ed9-578cd832f2d1 req-fa48985f-4197-4f31-83d2-cbed50f6dbb8 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:46.364829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-5fdc6d4b-ebc4-4911-9ed9-578cd832f2d1 req-fa48985f-4197-4f31-83d2-cbed50f6dbb8 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:46.365265 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-5fdc6d4b-ebc4-4911-9ed9-578cd832f2d1 req-fa48985f-4197-4f31-83d2-cbed50f6dbb8 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:46.376302 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-5fdc6d4b-ebc4-4911-9ed9-578cd832f2d1 req-fa48985f-4197-4f31-83d2-cbed50f6dbb8 service nova] Creating event network-vif-plugged:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:18:46.381642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-5fdc6d4b-ebc4-4911-9ed9-578cd832f2d1 req-fa48985f-4197-4f31-83d2-cbed50f6dbb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153080 Sep 09 21:18:46.382259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 514/1030] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:46.814761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:46.815445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:46.822276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:46.826825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:46.826825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:46.826825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:46.826825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:46.827298 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:47.033462 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:47.041642 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-63bfc423-ebe8-4c2c-968f-ff7ef0550eaf tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.230809 Sep 09 21:18:47.042205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 517/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:46 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:47.948081 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:47.953383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-4cea394f-1f06-4927-91b7-2f5d84402a46 req-009b59e7-b4c9-44cf-8a4b-57a680aec83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1665449d-cc36-47d4-b303-d0d82c5a5400", "tag": "8df13260-c81f-4a37-939e-ba952ce1f3f8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:47.960194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:47.963946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4cea394f-1f06-4927-91b7-2f5d84402a46 req-009b59e7-b4c9-44cf-8a4b-57a680aec83f service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:47.964572 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4cea394f-1f06-4927-91b7-2f5d84402a46 req-009b59e7-b4c9-44cf-8a4b-57a680aec83f service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:47.965008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-4cea394f-1f06-4927-91b7-2f5d84402a46 req-009b59e7-b4c9-44cf-8a4b-57a680aec83f service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:47.967017 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:47.967510 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:47.967939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:47.968890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:47.969345 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:47.969769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:47.976255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-4cea394f-1f06-4927-91b7-2f5d84402a46 req-009b59e7-b4c9-44cf-8a4b-57a680aec83f service nova] Creating event network-changed:8df13260-c81f-4a37-939e-ba952ce1f3f8 for instance 1665449d-cc36-47d4-b303-d0d82c5a5400 on hv-cinder-83124 Sep 09 21:18:47.981624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-4cea394f-1f06-4927-91b7-2f5d84402a46 req-009b59e7-b4c9-44cf-8a4b-57a680aec83f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031745 Sep 09 21:18:47.985086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 518/1032] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:47.998812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:18:48.065986 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:48.066830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:48.073207 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:48.073699 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:48.074132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:48.074835 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:48.075291 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:48.075715 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:48.215799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-32891544-2931-4771-aeef-4c2657354014 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 204 len: 0 microversion: 2.1 time: 0.271616 Sep 09 21:18:48.216784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 515/1033] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:18:47 2022] DELETE /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:48.226706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:48.227751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:48.234431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:48.235011 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:48.235535 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:48.236352 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:48.236866 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:48.237356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:48.274329 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:48.282534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-76011540-6ecb-4189-88cc-4fa1106819da tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1357 microversion: 2.1 time: 0.221983 Sep 09 21:18:48.283467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 519/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:48 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:48.386329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:48.395633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f8d00930-3cda-41be-8314-b10794b94c5f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1573 microversion: 2.1 time: 0.173476 Sep 09 21:18:48.396637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 516/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:48 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:49.305411 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:49.305975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:49.312337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.312812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.313241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.313923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.314372 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.314786 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.424413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:49.425016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:49.431357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.431836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.432317 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.433038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.433487 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.433911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.440702 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:49.448505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-874f75c5-12da-43df-8b22-2838af44ef97 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1547 microversion: 2.1 time: 0.147035 Sep 09 21:18:49.449076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 520/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:49 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:49.470496 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:49.474903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:49.478058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.478606 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.479053 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.479755 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.480276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.480709 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.619667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:49.627413 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-beaebaf3-5f68-49c9-a58d-88a632cc773a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1573 microversion: 2.1 time: 0.206799 Sep 09 21:18:49.627978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 517/1037] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:49 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:49.647809 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:49.655669 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c3404fb4-8f34-4b82-a2b6-ad20ef39e4a8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1547 microversion: 2.1 time: 0.188967 Sep 09 21:18:49.656255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 521/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:49 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:18:49.677540 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:49.682378 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:49.683141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Searching by: {'deleted': False, 'project_id': 'a1261e5e82414293b96ce77482498a89'} {{(pid=121136) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 21:18:49.689621 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.690097 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.690528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.691775 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.692257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.692683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.779875 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.multi_cell_list [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121136) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 21:18:49.872515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4f36421d-4843-4e51-b752-21db8ad597ea tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198754 Sep 09 21:18:49.873004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 518/1039] 10.222.0.48 () {58 vars in 1125 bytes} [Fri Sep 9 21:18:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:49.884990 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:49.885608 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:49.891495 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.891972 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.892440 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:49.893132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:49.893585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:49.894008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:50.043339 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:50.051554 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-699788e0-766c-4130-8604-7ed0666a8147 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1547 microversion: 2.1 time: 0.170379 Sep 09 21:18:50.052134 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 522/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:49 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:50.651576 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:50.652245 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:50.659298 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:50.660891 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:50.661529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:50.662467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:50.663152 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:50.663576 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:50.888973 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:50.899529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5b4aa23c-ee22-45e4-8b90-115e56762c50 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1573 microversion: 2.1 time: 0.252029 Sep 09 21:18:50.912001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 519/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:50 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1573 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:51.146294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-c5598e1c-aaa4-49b9-8fd3-ee29019558b8 req-a8468f72-091d-4b64-ae4c-8f08202782f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1665449d-cc36-47d4-b303-d0d82c5a5400", "name": "network-vif-deleted", "tag": "8df13260-c81f-4a37-939e-ba952ce1f3f8"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:51.156567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-c5598e1c-aaa4-49b9-8fd3-ee29019558b8 req-a8468f72-091d-4b64-ae4c-8f08202782f0 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:51.157044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-c5598e1c-aaa4-49b9-8fd3-ee29019558b8 req-a8468f72-091d-4b64-ae4c-8f08202782f0 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:51.157469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-c5598e1c-aaa4-49b9-8fd3-ee29019558b8 req-a8468f72-091d-4b64-ae4c-8f08202782f0 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:51.168694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-c5598e1c-aaa4-49b9-8fd3-ee29019558b8 req-a8468f72-091d-4b64-ae4c-8f08202782f0 service nova] Creating event network-vif-deleted:8df13260-c81f-4a37-939e-ba952ce1f3f8 for instance 1665449d-cc36-47d4-b303-d0d82c5a5400 on hv-cinder-83124 Sep 09 21:18:51.173571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-c5598e1c-aaa4-49b9-8fd3-ee29019558b8 req-a8468f72-091d-4b64-ae4c-8f08202782f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031619 Sep 09 21:18:51.174152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 523/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:51.925180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:51.926414 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:51.933068 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:51.933616 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:51.938472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:51.938472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:51.938472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:51.938472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:51.953848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:51.999117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:52.006805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1b625f7d-547d-4e21-ae2a-312bec1071ea tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 200 len: 1223 microversion: 2.1 time: 0.085486 Sep 09 21:18:52.007560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 520/1043] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:51 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:52.974137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "404ef07a-5b57-4bdb-8ee8-f14e1799cfba"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:52.976742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:52.983063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:52.983553 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:52.983993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:52.984727 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:52.985182 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:52.985609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:53.029256 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:53.029861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 1665449d-cc36-47d4-b303-d0d82c5a5400] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:53.032186 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:53.037863 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:53.038529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:53.039194 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:53.039960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:53.040500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:53.040991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:53.058502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] HTTP exception thrown: Instance 1665449d-cc36-47d4-b303-d0d82c5a5400 could not be found. Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Request method failure captured: Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 HTTP/1.1 Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6s2RaZp0YltFHZJQPw9xGdVMsvbDiu3JeiD8HObs9cGDSDje66ChS0gAaMD7XXlLWvtDqhIa83W6kZRhxh9v1HdXi06VrdvbcHuArZH9do950dzRDvl4XUUzLOaPzSgd-pO0GtMIzybAWPwudjiz8ZD5xIaSKzfmFMEoXTxb7nHjDY Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:18:53.060667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-TestVolumeBootPattern-91379462 Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: f289a1bdd79b4ba0bf9499edb7729c9a Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 1665449d-cc36-47d4-b303-d0d82c5a5400 could not be found. Sep 09 21:18:53.063845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '1665449d-cc36-47d4-b303-d0d82c5a5400'} Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1665449d-cc36-47d4-b303-d0d82c5a5400 could not be found. Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:18:53.064965 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1665449d-cc36-47d4-b303-d0d82c5a5400 could not be found. Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1665449d-cc36-47d4-b303-d0d82c5a5400 could not be found. Sep 09 21:18:53.067276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:18:53.069515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Returning 404 to user: Instance 1665449d-cc36-47d4-b303-d0d82c5a5400 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:18:53.069515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-405abe03-15f7-473d-a864-12ae3f7702fa tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400" status: 404 len: 111 microversion: 2.1 time: 0.036978 Sep 09 21:18:53.069839 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 521/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:53 2022] GET /compute/v2.1/servers/1665449d-cc36-47d4-b303-d0d82c5a5400 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:18:53.078331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=100 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:54.192665 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6bdfbcf2-2bf8-459f-8784-3bf17d2e6f53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.222812 Sep 09 21:18:54.193382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 524/1045] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:18:52 2022] POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments => generated 194 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:56.390550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:56.391098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:56.398254 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-f56bace6-735a-40b2-b573-b6276f7dce77 req-c27f83e3-e39c-4ccd-8874-a4c512a3bed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08119519-4899-4fcf-9b2a-fea5c47e64f8", "tag": "36c919a2-d5cb-47bb-9b31-f9be3e317c67"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:56.404801 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:56.405241 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:18:56.405373 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:56.406147 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:56.406986 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:56.407498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:56.408310 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:56.415112 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f56bace6-735a-40b2-b573-b6276f7dce77 req-c27f83e3-e39c-4ccd-8874-a4c512a3bed4 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:56.415586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f56bace6-735a-40b2-b573-b6276f7dce77 req-c27f83e3-e39c-4ccd-8874-a4c512a3bed4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:56.416019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-f56bace6-735a-40b2-b573-b6276f7dce77 req-c27f83e3-e39c-4ccd-8874-a4c512a3bed4 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:56.427925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-f56bace6-735a-40b2-b573-b6276f7dce77 req-c27f83e3-e39c-4ccd-8874-a4c512a3bed4 service nova] Creating event network-changed:36c919a2-d5cb-47bb-9b31-f9be3e317c67 for instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 on hv-cinder-83124 Sep 09 21:18:56.433078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-f56bace6-735a-40b2-b573-b6276f7dce77 req-c27f83e3-e39c-4ccd-8874-a4c512a3bed4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039475 Sep 09 21:18:56.433796 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 525/1046] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:18:56.439290 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:18:56.702858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8206de92-dfc5-449d-a6da-e6b4116ff45b tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "DELETE /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 204 len: 0 microversion: 2.1 time: 0.316318 Sep 09 21:18:56.703618 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 522/1047] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:18:56 2022] DELETE /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:18:56.713367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:56.714141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:56.721062 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:56.721566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:56.721996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:56.723351 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:56.723808 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:56.724271 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:56.857993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:56.865973 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-071f9fc4-14cf-4f3f-8f1c-64c50b85c40d tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1574 microversion: 2.1 time: 0.156831 Sep 09 21:18:56.866542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 526/1048] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:56 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:57.889858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:57.890600 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:57.896963 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:57.897454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:57.897894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:57.898597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:57.899069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:57.899486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:58.039198 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:58.046938 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9617c33b-ef59-41ea-9e2d-279186b26de5 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1455 microversion: 2.1 time: 0.161417 Sep 09 21:18:58.047501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 523/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:57 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:18:58.167609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-6cf17449-e849-4c51-9272-1c8a68cb1732 req-66382733-311d-42b0-b098-0bb783dcbb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08119519-4899-4fcf-9b2a-fea5c47e64f8", "name": "network-vif-deleted", "tag": "36c919a2-d5cb-47bb-9b31-f9be3e317c67"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:18:58.177732 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-6cf17449-e849-4c51-9272-1c8a68cb1732 req-66382733-311d-42b0-b098-0bb783dcbb51 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:58.178771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-6cf17449-e849-4c51-9272-1c8a68cb1732 req-66382733-311d-42b0-b098-0bb783dcbb51 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:58.178771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-6cf17449-e849-4c51-9272-1c8a68cb1732 req-66382733-311d-42b0-b098-0bb783dcbb51 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:58.189604 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-6cf17449-e849-4c51-9272-1c8a68cb1732 req-66382733-311d-42b0-b098-0bb783dcbb51 service nova] Creating event network-vif-deleted:36c919a2-d5cb-47bb-9b31-f9be3e317c67 for instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 on hv-cinder-83124 Sep 09 21:18:58.194515 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-6cf17449-e849-4c51-9272-1c8a68cb1732 req-66382733-311d-42b0-b098-0bb783dcbb51 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030722 Sep 09 21:18:58.195079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 527/1050] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:18:59.070788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:18:59.071425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:18:59.077802 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:59.078286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:59.078721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:59.079411 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:59.079864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:59.080386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:59.110692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:18:59.111164 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:18:59.111595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:18:59.112034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lazy-loading 'fault' on Instance uuid 08119519-4899-4fcf-9b2a-fea5c47e64f8 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:18:59.151605 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f289a1bdd79b4ba0bf9499edb7729c9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8403c10131d45b7a3f34ae872ac9e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:18:59.159241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-00688928-08be-444c-b6df-6d459979e659 tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 200 len: 1229 microversion: 2.1 time: 0.092296 Sep 09 21:18:59.160470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 524/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:18:59 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:00.184314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:00.185008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: 08119519-4899-4fcf-9b2a-fea5c47e64f8] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:00.191047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:00.191529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:00.191958 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:00.192662 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:00.193117 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:00.193534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:00.206546 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] HTTP exception thrown: Instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 could not be found. Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Request method failure captured: Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 HTTP/1.1 Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6s2RaZp0YltFHZJQPw9xGdVMsvbDiu3JeiD8HObs9cGDSDje66ChS0gAaMD7XXlLWvtDqhIa83W6kZRhxh9v1HdXi06VrdvbcHuArZH9do950dzRDvl4XUUzLOaPzSgd-pO0GtMIzybAWPwudjiz8ZD5xIaSKzfmFMEoXTxb7nHjDY Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:19:00.208428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: f289a1bdd79b4ba0bf9499edb7729c9a Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 could not be found. Sep 09 21:19:00.210137 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '08119519-4899-4fcf-9b2a-fea5c47e64f8'} Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 could not be found. Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:00.211084 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 could not be found. Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 could not be found. Sep 09 21:19:00.212690 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.214321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Returning 404 to user: Instance 08119519-4899-4fcf-9b2a-fea5c47e64f8 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:00.214321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-134396bf-5afc-4817-bbd0-200a8ac7f28a tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8" status: 404 len: 111 microversion: 2.1 time: 0.030522 Sep 09 21:19:00.214321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 528/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:00 2022] GET /compute/v2.1/servers/08119519-4899-4fcf-9b2a-fea5c47e64f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:19:00.695183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:00.695703 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:00.697680 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:00.702853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:00.703333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:00.703768 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:00.704485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:00.704937 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:00.708490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:00.719235 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] HTTP exception thrown: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Request method failure captured: Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b HTTP/1.1 Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG6s2RaZp0YltFHZJQPw9xGdVMsvbDiu3JeiD8HObs9cGDSDje66ChS0gAaMD7XXlLWvtDqhIa83W6kZRhxh9v1HdXi06VrdvbcHuArZH9do950dzRDvl4XUUzLOaPzSgd-pO0GtMIzybAWPwudjiz8ZD5xIaSKzfmFMEoXTxb7nHjDY Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:19:00.720898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: f289a1bdd79b4ba0bf9499edb7729c9a Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.723101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'fc24ffe5-abae-40e0-95af-cd8318ed087b'} Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:00.723952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.725273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.726736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Returning 404 to user: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:00.726736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c026a82e-b9fb-4b58-bed8-25c88f1abb0e tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 404 len: 111 microversion: 2.1 time: 0.031057 Sep 09 21:19:00.726736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 525/1053] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:19:00 2022] DELETE /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:19:00.731370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:00.731985 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] [instance: fc24ffe5-abae-40e0-95af-cd8318ed087b] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:00.737843 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:00.738322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:00.738757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:00.739449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:00.739901 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:00.740373 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:00.753888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] HTTP exception thrown: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Request method failure captured: Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b HTTP/1.1 Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG6s2RaZp0YltFHZJQPw9xGdVMsvbDiu3JeiD8HObs9cGDSDje66ChS0gAaMD7XXlLWvtDqhIa83W6kZRhxh9v1HdXi06VrdvbcHuArZH9do950dzRDvl4XUUzLOaPzSgd-pO0GtMIzybAWPwudjiz8ZD5xIaSKzfmFMEoXTxb7nHjDY Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:19:00.755378 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8403c10131d45b7a3f34ae872ac9e9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: c8403c10131d45b7a3f34ae872ac9e9e Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-TestVolumeBootPattern-91379462 Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: f289a1bdd79b4ba0bf9499edb7729c9a Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-TestVolumeBootPattern-91379462-project Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.757178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'fc24ffe5-abae-40e0-95af-cd8318ed087b'} Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:19:00.758704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. Sep 09 21:19:00.760476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:19:00.761817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Returning 404 to user: Instance fc24ffe5-abae-40e0-95af-cd8318ed087b could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:19:00.761817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-099820e1-731e-473a-b4fc-ee74ed74255f tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b" status: 404 len: 111 microversion: 2.1 time: 0.029153 Sep 09 21:19:00.761817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 529/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:00 2022] GET /compute/v2.1/servers/fc24ffe5-abae-40e0-95af-cd8318ed087b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:19:02.256438 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c7cc37a4-fabb-4458-a6fa-e6d09813e2eb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] Calling method '.version_select at 0x7fa1d0d694c0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:02.338141 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c7cc37a4-fabb-4458-a6fa-e6d09813e2eb tempest-TestVolumeBootPattern-91379462 tempest-TestVolumeBootPattern-91379462-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-704010936" status: 202 len: 0 microversion: 2.1 time: 0.086173 Sep 09 21:19:02.338849 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 526/1055] 10.222.0.48 () {58 vars in 1260 bytes} [Fri Sep 9 21:19:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-704010936 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:19:02.846742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:02.847917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:02.854231 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:02.854719 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:02.855158 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:02.855858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:02.856421 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:02.856858 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:03.078849 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:03.089311 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a0f2f09a-4a15-4f82-a13a-bfd0855dd7e6 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1593 microversion: 2.1 time: 0.246304 Sep 09 21:19:03.091245 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 530/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:02 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1593 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:05.083399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-f6a750a6-5096-4617-94fb-553614723cb3 req-a46b5375-c93f-4588-a2cc-ad3535776f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:05.104840 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-f6a750a6-5096-4617-94fb-553614723cb3 req-a46b5375-c93f-4588-a2cc-ad3535776f2d service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:05.105283 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-f6a750a6-5096-4617-94fb-553614723cb3 req-a46b5375-c93f-4588-a2cc-ad3535776f2d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:05.105962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-f6a750a6-5096-4617-94fb-553614723cb3 req-a46b5375-c93f-4588-a2cc-ad3535776f2d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:05.119534 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-f6a750a6-5096-4617-94fb-553614723cb3 req-a46b5375-c93f-4588-a2cc-ad3535776f2d service nova] Creating event network-changed:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:19:05.129236 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-f6a750a6-5096-4617-94fb-553614723cb3 req-a46b5375-c93f-4588-a2cc-ad3535776f2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051727 Sep 09 21:19:05.130569 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 527/1057] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:07.044627 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:07.045133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:07.052505 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:07.052918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:07.053558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:07.054427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:07.055149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:07.055743 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:07.079301 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-682ed2d3-7193-4c46-8d75-53c9303d1d32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/ips" status: 200 len: 149 microversion: 2.1 time: 0.038479 Sep 09 21:19:07.079862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 531/1058] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:19:07 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:07.764800 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-202437159"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:07.765511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:07.772477 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:07.773035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:07.773476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:07.774177 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:07.774647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:07.775070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:08.032739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.network.security_group_api [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Adding security group 3264c306-2688-4856-b927-7f9894848208 to port 69a39d7b-18e5-48b0-b530-5d248c13c509 Sep 09 21:19:08.871533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de7c53c-d1cf-40a2-8334-c1384e193b7e"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:08.874268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:08.880550 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:08.881013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:08.881453 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:08.882183 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:08.882639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:08.883109 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:08.952033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4fadee8d-7c84-43fa-90c0-1b70906484a0 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/action" status: 202 len: 0 microversion: 2.1 time: 1.192443 Sep 09 21:19:08.955741 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 528/1059] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:19:07 2022] POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/action => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:19:08.963049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:08.967117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:08.975887 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:08.976640 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:08.977272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:08.978183 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:08.979671 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:08.980322 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:09.164490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:09.179143 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-899d991a-0ff0-4b82-9e91-9bf6e32103b5 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1758 microversion: 2.1 time: 0.221642 Sep 09 21:19:09.180309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 529/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:08 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:09.186500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-821beac9-b6c8-497e-9e79-441dedc58ce1 req-7c8f3844-5f39-48f1-9329-84e7e6ed4003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:09.201922 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-821beac9-b6c8-497e-9e79-441dedc58ce1 req-7c8f3844-5f39-48f1-9329-84e7e6ed4003 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:09.202564 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-821beac9-b6c8-497e-9e79-441dedc58ce1 req-7c8f3844-5f39-48f1-9329-84e7e6ed4003 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:09.203848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-821beac9-b6c8-497e-9e79-441dedc58ce1 req-7c8f3844-5f39-48f1-9329-84e7e6ed4003 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:09.220549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-821beac9-b6c8-497e-9e79-441dedc58ce1 req-7c8f3844-5f39-48f1-9329-84e7e6ed4003 service nova] Creating event network-changed:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:19:09.233434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-821beac9-b6c8-497e-9e79-441dedc58ce1 req-7c8f3844-5f39-48f1-9329-84e7e6ed4003 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051150 Sep 09 21:19:09.234149 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 530/1061] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:09.724897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9377711f-e312-46c5-8d57-6f8618ebf79d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857279 Sep 09 21:19:09.725613 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 532/1062] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:19:08 2022] POST /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:19:18.342975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-64fde769-49ad-429f-a803-c4e95585814c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: .version_select at 0x7fa1d0d694c0>, body: {"keypair": {"name": "tempest-keypair-1199880001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5q11ElhUXdI6zdMHYtbX8S7ooAaAdBnMO+i/YgGuevyz6yjkFI+jgujt628j26yi61xaDsjkmjjl3ISrirqh8h6wTz/A3JsIwr/lEU2OjqYR2C+p2q5duO7YryY7l9Dg=="}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:18.358385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-64fde769-49ad-429f-a803-c4e95585814c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:19:18.362711 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-64fde769-49ad-429f-a803-c4e95585814c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:19:18.486841 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-64fde769-49ad-429f-a803-c4e95585814c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148595 Sep 09 21:19:18.487918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 531/1063] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:19:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:20.632414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=15 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.633203 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:20.637940 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1280341772", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0801b011-6de8-408c-b234-30930e8ba97f"}], "security_groups": [{"name": "tempest-securitygroup--910851857"}], "key_name": "tempest-keypair-1199880001", "user_data": "}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:20.740110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.network.neutron [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] validate_networks() for [('0801b011-6de8-408c-b234-30930e8ba97f', None, None, None, None, None)] {{(pid=121137) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:19:21.108090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:19:21.108530 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image limits 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:19:21.109034 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:19:21.109446 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image pref 0:0:0 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:19:21.109862 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.virt.hardware [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:19:21.119108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:21.119592 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:21.120028 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:21.120791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:21.121253 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:21.121689 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:21.137996 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:19:21.141945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:19:21.152661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Going to run 1 instances... {{(pid=121137) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:19:21.155026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:19:21.281866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d23be58c-8b5e-46ee-9f7b-6bf459612ae9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.650895 Sep 09 21:19:21.282597 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 533/1064] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:19:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:19:21.291433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:21.296064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f25ea3c9-1ec2-453a-83f9-a898ecaa6477 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:21.296784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f25ea3c9-1ec2-453a-83f9-a898ecaa6477 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:21.352838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f25ea3c9-1ec2-453a-83f9-a898ecaa6477 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:21.360127 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f25ea3c9-1ec2-453a-83f9-a898ecaa6477 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1242 microversion: 2.1 time: 0.069491 Sep 09 21:19:21.360702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 532/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:21 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:22.383507 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:22.384182 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:22.391293 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:22.391776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:22.392255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:22.392942 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:22.393465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:22.393889 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:22.456893 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:22.464913 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-accfb6fa-fc43-4a19-ba60-768615386d16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1246 microversion: 2.1 time: 0.085822 Sep 09 21:19:22.465467 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 534/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:22 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:23.488034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:23.488683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:23.495136 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:23.495625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:23.496080 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:23.496789 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:23.497243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:23.497668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:23.568606 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:23.576655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-67532e43-428b-4c45-b38c-bada7d36ed80 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1302 microversion: 2.1 time: 0.092942 Sep 09 21:19:23.588289 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 533/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:23 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:24.604476 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:24.605200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:24.615500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:24.616002 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:24.616587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:24.617305 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:24.617773 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:24.618203 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:24.749216 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:24.757428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8b685b98-c1a5-4149-b9ec-e391e790944b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.159017 Sep 09 21:19:24.758116 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 535/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:24 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:25.175528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-191200b6-f550-4958-8d4f-3505ef055b5a req-3d2953ce-6e4d-4e0a-8d12-72591a470dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d395dce9-8a04-4f12-abfb-12246ee5f1d6", "tag": "fbb7bf35-8f10-4356-aa68-26f8cda2c99f"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:25.185941 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-191200b6-f550-4958-8d4f-3505ef055b5a req-3d2953ce-6e4d-4e0a-8d12-72591a470dd0 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:25.186432 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-191200b6-f550-4958-8d4f-3505ef055b5a req-3d2953ce-6e4d-4e0a-8d12-72591a470dd0 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:25.186858 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-191200b6-f550-4958-8d4f-3505ef055b5a req-3d2953ce-6e4d-4e0a-8d12-72591a470dd0 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:25.197555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-191200b6-f550-4958-8d4f-3505ef055b5a req-3d2953ce-6e4d-4e0a-8d12-72591a470dd0 service nova] Creating event network-changed:fbb7bf35-8f10-4356-aa68-26f8cda2c99f for instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 on hv-cinder-83124 Sep 09 21:19:25.202919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-191200b6-f550-4958-8d4f-3505ef055b5a req-3d2953ce-6e4d-4e0a-8d12-72591a470dd0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032774 Sep 09 21:19:25.203506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 534/1069] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:25.780785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:25.781316 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:25.788076 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:25.788570 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:25.788999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:25.789685 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:25.790132 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:25.790548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:25.917248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:25.925068 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f94fcc9f-dd65-4757-b63e-17c749c0f4e3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.148171 Sep 09 21:19:25.925630 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 536/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:25 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:26.948769 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:26.949473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:26.951810 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:26.956690 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:26.957164 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:26.957860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:26.958544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:26.959028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:26.959407 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:27.092967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:27.100945 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ea08c153-bee0-41d9-a1b1-b558c877f9b7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.156431 Sep 09 21:19:27.101505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 535/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:26 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:28.124275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:28.124891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:28.132055 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:28.132596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:28.133031 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:28.133725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:28.134176 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:28.134596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:28.271610 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:28.273317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-15201803-4063-4332-be27-f3dd34b64987 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.152870 Sep 09 21:19:28.273904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 537/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:28 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:29.295641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:29.296227 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:29.302635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:29.303114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:29.303550 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:29.304277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:29.304732 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:29.305156 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:29.437472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:29.444511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e433fab0-538e-44f3-850d-9e1ee0123530 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.152807 Sep 09 21:19:29.445065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 536/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:29 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:30.427757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-dab63535-8233-4d30-834d-7c0a396e9356 req-1cbd7db1-8087-4fb6-9d32-72608b60ab08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d395dce9-8a04-4f12-abfb-12246ee5f1d6", "name": "network-vif-plugged", "status": "completed", "tag": "fbb7bf35-8f10-4356-aa68-26f8cda2c99f"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:30.438149 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-dab63535-8233-4d30-834d-7c0a396e9356 req-1cbd7db1-8087-4fb6-9d32-72608b60ab08 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:30.438625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-dab63535-8233-4d30-834d-7c0a396e9356 req-1cbd7db1-8087-4fb6-9d32-72608b60ab08 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:30.439045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-dab63535-8233-4d30-834d-7c0a396e9356 req-1cbd7db1-8087-4fb6-9d32-72608b60ab08 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:30.450275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-dab63535-8233-4d30-834d-7c0a396e9356 req-1cbd7db1-8087-4fb6-9d32-72608b60ab08 service nova] Creating event network-vif-plugged:fbb7bf35-8f10-4356-aa68-26f8cda2c99f for instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 on hv-cinder-83124 Sep 09 21:19:30.455393 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-dab63535-8233-4d30-834d-7c0a396e9356 req-1cbd7db1-8087-4fb6-9d32-72608b60ab08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Sep 09 21:19:30.456170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 538/1074] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:30.467716 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:30.468406 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:30.474774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:30.476094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:30.476094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:30.476390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:30.476845 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:30.477272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:30.618405 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:30.625990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c9cbda27-6ab8-43bf-90a0-938abde01b7b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.162169 Sep 09 21:19:30.626568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 537/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:30 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:31.649952 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:31.650657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:31.652615 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:31.653281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:31.658698 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:31.662135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:31.662135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:31.662135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:31.662135 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:31.662602 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:31.786730 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:31.794306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3cbf9e7e-4a4e-476a-81f2-41448110819d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1367 microversion: 2.1 time: 0.148529 Sep 09 21:19:31.794860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 539/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:31 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:32.816123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:32.816824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:32.818688 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:32.823781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:32.824306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:32.824742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:32.825504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:32.826004 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:32.826425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:32.958948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:32.966662 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9ce32b22-6b48-4ddb-a75f-2607a98b845c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1557 microversion: 2.1 time: 0.154480 Sep 09 21:19:32.967224 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 538/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:32 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:32.989362 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:32.989902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:32.996196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:33.000317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:33.000317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:33.000317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:33.000317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:33.000737 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:33.077017 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0f92b564-a63d-4862-8a73-336f58c4e1d9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091475 Sep 09 21:19:33.077614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 540/1078] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:19:32 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:34.009400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-66668952-24dc-4d43-824f-0c8137a7099f req-164286ea-34b1-42f4-b23d-4a24b94e9f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d395dce9-8a04-4f12-abfb-12246ee5f1d6", "tag": "fbb7bf35-8f10-4356-aa68-26f8cda2c99f"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:34.019491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-66668952-24dc-4d43-824f-0c8137a7099f req-164286ea-34b1-42f4-b23d-4a24b94e9f58 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:34.019964 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-66668952-24dc-4d43-824f-0c8137a7099f req-164286ea-34b1-42f4-b23d-4a24b94e9f58 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:34.020410 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-66668952-24dc-4d43-824f-0c8137a7099f req-164286ea-34b1-42f4-b23d-4a24b94e9f58 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:34.031376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-66668952-24dc-4d43-824f-0c8137a7099f req-164286ea-34b1-42f4-b23d-4a24b94e9f58 service nova] Creating event network-changed:fbb7bf35-8f10-4356-aa68-26f8cda2c99f for instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 on hv-cinder-83124 Sep 09 21:19:34.037109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-66668952-24dc-4d43-824f-0c8137a7099f req-164286ea-34b1-42f4-b23d-4a24b94e9f58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031245 Sep 09 21:19:34.037930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 539/1079] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:19:57.364443 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.365208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=38 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.369164 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:19:57.371428 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:57.377086 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:57.377566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:57.378652 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:57.379335 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:57.379781 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:57.380266 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:57.533974 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-876991fb-f43c-443f-9c74-1d71508858d3 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/action" status: 202 len: 0 microversion: 2.1 time: 0.171394 Sep 09 21:19:57.534661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 541/1080] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:19:57 2022] POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:19:57.540962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=9 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.541766 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=34 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:19:57.545740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:57.546441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:57.552925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:57.553402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:57.553831 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:57.554543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:57.554991 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:57.555408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:57.698095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:57.706276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9f71d48d-7af5-4718-9a91-364db2c65b26 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1750 microversion: 2.1 time: 0.167160 Sep 09 21:19:57.706847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 540/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:57 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:58.730625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:58.731435 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:58.738789 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:58.746494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:58.746494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:58.746494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:58.746494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:58.746961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:58.892486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:19:58.901118 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c83b2e97-56bc-49d9-8fde-f59bf9841758 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.174903 Sep 09 21:19:58.901867 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 542/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:58 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:19:59.925455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:19:59.926099 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:19:59.932693 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:59.933179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:59.933617 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:19:59.934309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:19:59.934762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:19:59.935188 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:00.078681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:00.087201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-018089de-e0d7-42c6-a06c-cda6d8b46848 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.166195 Sep 09 21:20:00.088153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 541/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:19:59 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:01.111647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:01.112728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:01.119070 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:01.119543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:01.119968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:01.120673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:01.121121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:01.121534 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:01.260960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:01.269817 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0bb36037-30d6-435b-95eb-0a0aedccb977 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.162041 Sep 09 21:20:01.270386 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 543/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:01 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:02.292276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:02.292814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:02.299115 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:02.299599 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:02.300060 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:02.300764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:02.301216 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:02.301636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:02.443607 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:02.451834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-677fd48a-baeb-4d7b-8f50-afa793515a7b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.163551 Sep 09 21:20:02.452428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 542/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:02 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:03.474829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:03.475442 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:03.482294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:03.482776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:03.483210 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:03.483898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:03.484379 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:03.484798 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:03.623235 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:03.631992 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1eb139a5-6496-4086-9c0b-492366c3cb46 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.161155 Sep 09 21:20:03.632577 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 544/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:03 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:04.654059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:04.654674 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:04.661727 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:04.662161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:04.662596 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:04.663286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:04.663733 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:04.664178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:04.810995 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:04.819781 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a4a8d752-ff6f-46df-87e3-1e1fca6da345 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.169553 Sep 09 21:20:04.820371 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 543/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:04 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:05.843612 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:05.844258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:05.851222 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:05.851704 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:05.852175 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:05.852868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:05.853324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:05.853750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:05.990951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:05.999087 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-3188d767-1f87-4792-8e11-d45ee777ab53 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.159363 Sep 09 21:20:05.999647 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 545/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:05 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:07.022384 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:07.023006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:07.029374 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:07.029855 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:07.030293 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:07.030981 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:07.031431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:07.031853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:07.171067 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:07.179098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ab3d1197-01a3-4336-83dd-055ce8f78722 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.160626 Sep 09 21:20:07.179656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 544/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:07 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:08.202336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:08.203639 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:08.210574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:08.211056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:08.213605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:08.213605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:08.213605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:08.213605 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:08.604052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:08.612190 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-eb145522-5bbd-4218-aee2-835949dc51d1 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.413995 Sep 09 21:20:08.612750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 546/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:08 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:09.634890 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:09.635585 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:09.642016 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:09.642498 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:09.642939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:09.644159 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:09.644616 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:09.645041 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:09.784385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:09.792476 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d3aeebab-8754-4b33-a3c2-51812ecf283b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.161422 Sep 09 21:20:09.793037 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 545/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:09 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:10.816240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:10.816860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:10.823350 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:10.823828 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:10.824318 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:10.824991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:10.825439 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:10.825859 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:10.976524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:10.984788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6c701504-0ccb-4b43-b141-af8e25eed389 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.172926 Sep 09 21:20:10.985349 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 547/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:10 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:12.008027 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:12.008752 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:12.015202 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:12.015687 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:12.016142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:12.016836 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:12.017288 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:12.017708 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:12.153754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:12.162374 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-1273ccd5-4cbf-455e-b2e4-13f013a4458f tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.158236 Sep 09 21:20:12.162933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 546/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:12 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:13.185657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:13.186272 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:13.192750 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:13.193220 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:13.193651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:13.194486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:13.194931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:13.195346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:13.336092 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:13.344219 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-46873b36-63ae-4543-817b-c24901e653b9 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1755 microversion: 2.1 time: 0.162380 Sep 09 21:20:13.344785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 548/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:13 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:14.368505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:14.369048 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:14.375330 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:14.375806 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:14.376276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:14.376960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:14.377455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:14.377873 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:14.514797 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:14.522955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6c05418c-f818-4286-a315-9807b6f1e999 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1758 microversion: 2.1 time: 0.158299 Sep 09 21:20:14.523517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 547/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:14 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1758 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:49.154843 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:49.155415 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:49.157628 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=16 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:49.158449 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:49.163540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.164018 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.164481 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.165170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.165622 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.166044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.188329 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-29ed3ac2-387e-4f27-9e29-5bcb51b32ace tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/ips" status: 200 len: 148 microversion: 2.1 time: 0.037283 Sep 09 21:20:49.188881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 549/1096] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:20:49 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:20:49.200589 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de7c53c-d1cf-40a2-8334-c1384e193b7e"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:20:49.203045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:49.205133 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=16 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:49.205794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=48 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:20:49.212019 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.212532 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.212978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.213683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.214217 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.214647 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.446717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Invalid volume: volume 5de7c53c-d1cf-40a2-8334-c1384e193b7e is already attached to instances: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: POST /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/os-volume_attachments HTTP/1.1 Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 74 Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:20:49.448958 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {"volumeAttachment": {"volumeId": "5de7c53c-d1cf-40a2-8334-c1384e193b7e"}} Sep 09 21:20:49.450633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Invalid volume: volume 5de7c53c-d1cf-40a2-8334-c1384e193b7e is already attached to instances: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'server_id': 'd395dce9-8a04-4f12-abfb-12246ee5f1d6', 'body': {'volumeAttachment': {'volumeId': '5de7c53c-d1cf-40a2-8334-c1384e193b7e'}}} Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5de7c53c-d1cf-40a2-8334-c1384e193b7e is already attached to instances: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:20:49.451582 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5de7c53c-d1cf-40a2-8334-c1384e193b7e is already attached to instances: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:20:49.452943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5de7c53c-d1cf-40a2-8334-c1384e193b7e is already attached to instances: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 400 to user: Invalid volume: volume 5de7c53c-d1cf-40a2-8334-c1384e193b7e is already attached to instances: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9ff599ae-a925-446e-ba63-66e0031726a3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.254017 Sep 09 21:20:49.454479 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 548/1097] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:20:49 2022] POST /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6/os-volume_attachments => generated 174 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:20:49.459951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:49.460487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:49.467276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.467756 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.468229 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.468924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.469382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.469809 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.498571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:20:49.773691 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-fdf8155a-7bf6-4bd8-bb2e-a6eb8b2a235e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 204 len: 0 microversion: 2.1 time: 0.318202 Sep 09 21:20:49.774267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 550/1098] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:20:49 2022] DELETE /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 21:20:49.782360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:49.782970 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:49.789642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.790124 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.790555 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.791241 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:49.791692 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:49.792138 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:49.921853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:49.929461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-779806a4-0b3a-4ee6-a5eb-208abf42c0dd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1680 microversion: 2.1 time: 0.150960 Sep 09 21:20:49.930026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 549/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:49 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:50.953995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:50.954703 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:50.961262 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:50.961744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:50.962178 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:50.962875 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:50.963324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:50.963742 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:51.188303 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:51.195898 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0e8de4c9-7337-4bbf-836c-684a63d8f40c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1680 microversion: 2.1 time: 0.246296 Sep 09 21:20:51.196486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 551/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:50 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:52.219812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:52.220451 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:52.226948 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:52.227461 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:52.227900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:52.228620 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:52.229074 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:52.229499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:52.364967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:52.373668 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b862a71c-c97a-4a67-a7d1-d17d38316a56 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1680 microversion: 2.1 time: 0.157732 Sep 09 21:20:52.374173 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 550/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:52 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:52.853131 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-033498e1-f59f-4f6f-a36c-c4cc408518a6 req-0fcf4140-a877-4eca-89e7-deb636fe03cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d395dce9-8a04-4f12-abfb-12246ee5f1d6", "name": "network-vif-deleted", "tag": "fbb7bf35-8f10-4356-aa68-26f8cda2c99f"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:20:52.863767 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-033498e1-f59f-4f6f-a36c-c4cc408518a6 req-0fcf4140-a877-4eca-89e7-deb636fe03cd service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:52.868564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-033498e1-f59f-4f6f-a36c-c4cc408518a6 req-0fcf4140-a877-4eca-89e7-deb636fe03cd service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:52.868564 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-033498e1-f59f-4f6f-a36c-c4cc408518a6 req-0fcf4140-a877-4eca-89e7-deb636fe03cd service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:52.875916 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-033498e1-f59f-4f6f-a36c-c4cc408518a6 req-0fcf4140-a877-4eca-89e7-deb636fe03cd service nova] Creating event network-vif-deleted:fbb7bf35-8f10-4356-aa68-26f8cda2c99f for instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 on hv-cinder-83124 Sep 09 21:20:52.880982 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-033498e1-f59f-4f6f-a36c-c4cc408518a6 req-0fcf4140-a877-4eca-89e7-deb636fe03cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Sep 09 21:20:52.881599 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 552/1102] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:20:53.397029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:53.397656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:53.404739 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:53.405313 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:53.405814 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:53.406613 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:53.407132 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:53.407615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:53.438264 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:53.438772 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:53.439209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:53.439681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'fault' on Instance uuid d395dce9-8a04-4f12-abfb-12246ee5f1d6 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:20:53.479784 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:53.487454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-27a6d37e-d0e3-42e0-85b6-6c82ab653c67 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 200 len: 1332 microversion: 2.1 time: 0.094323 Sep 09 21:20:53.488121 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 551/1103] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:53 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:54.511829 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:54.512567 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:54.518736 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:54.519217 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:54.519651 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:54.520377 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:54.520834 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:54.521255 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:54.535267 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 HTTP/1.1 Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:20:54.536894 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:20:54.542903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'd395dce9-8a04-4f12-abfb-12246ee5f1d6'} Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:20:54.543729 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:20:54.545129 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:20:54.546354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:20:54.546354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-717b7c64-b2ca-4531-abcf-3a3db8cd6bf2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 404 len: 111 microversion: 2.1 time: 0.031199 Sep 09 21:20:54.546354 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 553/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:54 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:20:54.547776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d2a8a35e-05d3-40c3-b25a-52f35d4f47c0 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '.version_select at 0x7fa1d17d2310>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:54.631543 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d2a8a35e-05d3-40c3-b25a-52f35d4f47c0 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199880001" status: 202 len: 0 microversion: 2.1 time: 0.087497 Sep 09 21:20:54.632139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 552/1105] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Sep 9 21:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199880001 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:20:55.447991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:55.448614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:55.454535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:55.455008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:55.455499 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:55.456214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:55.456667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:55.457081 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:55.538176 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'services' on Instance uuid 8e1c1de6-e162-4413-8fae-d5ccbdfac60e {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:20:55.729291 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-82c9e090-13e8-47be-b99d-3443bb44657c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments/5de7c53c-d1cf-40a2-8334-c1384e193b7e" status: 202 len: 0 microversion: 2.1 time: 0.289721 Sep 09 21:20:55.729867 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 554/1106] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:20:55 2022] DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments/5de7c53c-d1cf-40a2-8334-c1384e193b7e => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:20:55.738700 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:55.740899 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:55.748272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:55.748762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:55.749209 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:55.749911 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:55.750367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:55.750794 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:55.780386 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9111070d-0f0b-4633-84bf-3a22bf59526e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046043 Sep 09 21:20:55.780953 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 553/1107] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:20:55 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:20:56.794650 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:56.796916 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:56.802964 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:56.803445 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:56.803881 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:56.805144 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:56.805598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:56.806021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:56.835106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2c2a41f5-f166-4ef4-83d2-a411f658ae2a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Sep 09 21:20:56.835803 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 555/1108] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:20:56 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:20:57.846990 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:57.849175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:57.855420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:57.855894 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:57.856359 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:57.857070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:57.857521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:57.857940 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:57.885754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3daf01fe-04d0-43af-8920-07972ac33c9c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042759 Sep 09 21:20:57.886294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 554/1109] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:20:57 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:20:57.948319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:57.948850 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:57.954976 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:57.955452 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:57.955882 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:57.956586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:57.957030 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:57.957447 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:57.982047 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:20:58.261578 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a3f09fbd-649f-41c7-af45-0f9a1aca4bfc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 204 len: 0 microversion: 2.1 time: 0.317067 Sep 09 21:20:58.262161 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 556/1110] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:20:57 2022] DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:20:58.270830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:58.271433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:58.278365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:58.278837 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:58.279268 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:58.279949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:58.280501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:58.280915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:58.410180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:58.418201 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-01736caf-a7dc-4d9c-b7dd-643c809abb3f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1679 microversion: 2.1 time: 0.151639 Sep 09 21:20:58.418770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 555/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:58 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:20:59.442045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:20:59.442744 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:20:59.449757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:59.450233 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:59.450667 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:59.451351 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:20:59.451801 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:20:59.452257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:20:59.577513 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:20:59.585780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e4fcbe6b-074c-4dfd-a617-37ff750c6f16 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1679 microversion: 2.1 time: 0.147884 Sep 09 21:20:59.586361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 557/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:20:59 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:00.609681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:00.614395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:00.617050 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:00.618123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:00.618568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:00.619273 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:00.619728 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:00.620176 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:00.755501 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:00.763816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4dcb63c4-0a4f-4dbe-88c9-1bcf0ed201c9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1679 microversion: 2.1 time: 0.157965 Sep 09 21:21:00.769666 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 556/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:00 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:01.222463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-0b61ebdd-b72a-4e37-8c4a-a4973b1e35f8 req-cf85f8d9-b0da-481f-b36c-e80b887e0bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1c1de6-e162-4413-8fae-d5ccbdfac60e", "name": "network-vif-deleted", "tag": "16ea8775-e00c-4e03-b05f-871b94eb79ad"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:01.232276 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-0b61ebdd-b72a-4e37-8c4a-a4973b1e35f8 req-cf85f8d9-b0da-481f-b36c-e80b887e0bcf service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:01.236063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-0b61ebdd-b72a-4e37-8c4a-a4973b1e35f8 req-cf85f8d9-b0da-481f-b36c-e80b887e0bcf service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:01.236063 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-0b61ebdd-b72a-4e37-8c4a-a4973b1e35f8 req-cf85f8d9-b0da-481f-b36c-e80b887e0bcf service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:01.244937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-0b61ebdd-b72a-4e37-8c4a-a4973b1e35f8 req-cf85f8d9-b0da-481f-b36c-e80b887e0bcf service nova] Creating event network-vif-deleted:16ea8775-e00c-4e03-b05f-871b94eb79ad for instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e on hv-cinder-83124 Sep 09 21:21:01.249903 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-0b61ebdd-b72a-4e37-8c4a-a4973b1e35f8 req-cf85f8d9-b0da-481f-b36c-e80b887e0bcf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 Sep 09 21:21:01.250780 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 558/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:01.788103 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:01.788738 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:01.794992 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:01.795468 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:01.795900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:01.796903 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:01.797355 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:01.797774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:01.829635 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:01.830123 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:01.830554 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:01.831002 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'fault' on Instance uuid 8e1c1de6-e162-4413-8fae-d5ccbdfac60e {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:21:01.871702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:01.879514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dd3cbac3-db56-48d4-b6bc-28965115f42f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 200 len: 1330 microversion: 2.1 time: 0.095361 Sep 09 21:21:01.880111 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 557/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:01 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:02.904911 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:02.905616 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:02.911771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:02.912295 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:02.912733 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:02.913422 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:02.914526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:02.915013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:02.937888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e HTTP/1.1 Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:21:02.939545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:21:02.941099 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '8e1c1de6-e162-4413-8fae-d5ccbdfac60e'} Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:21:02.942074 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:21:02.943868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:02.945487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:21:02.945487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-10c3db2e-5ec7-4e00-95e7-9c881ab6c28a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 404 len: 111 microversion: 2.1 time: 0.040800 Sep 09 21:21:02.945487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 559/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:02 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:21:02.949853 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-02ba0587-115a-4c32-a6f7-b3e223aaf4b2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '.version_select at 0x7fa1d1771d30>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:03.059999 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-02ba0587-115a-4c32-a6f7-b3e223aaf4b2 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985352337" status: 202 len: 0 microversion: 2.1 time: 0.113827 Sep 09 21:21:03.060653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 558/1117] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Sep 9 21:21:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985352337 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:21:03.796460 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-800b04d3-a78a-4067-88d8-520db6a8a76e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: .version_select at 0x7fa1d0b46700>, body: {"keypair": {"name": "tempest-keypair-1996651110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0vtOddqyf0F0SjqyRBzqOjUvw6/jVqwoi/B+F7WMblSNyid5Hcrewl+M1MzWKX3IQhhmJ3epozp/O+EI3sSm3425VIDD1JcMLhwqmIkeWoq+8xAOMsN+XOHFnCL3Wqcg=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:03.811853 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-800b04d3-a78a-4067-88d8-520db6a8a76e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:21:03.815593 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-800b04d3-a78a-4067-88d8-520db6a8a76e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:21:03.827051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR oslo.messaging._drivers.impl_rabbit [None req-800b04d3-a78a-4067-88d8-520db6a8a76e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [d148929f-e63d-491e-a289-dd6adba2a11b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:21:04.834885 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO oslo.messaging._drivers.impl_rabbit [None req-800b04d3-a78a-4067-88d8-520db6a8a76e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [d148929f-e63d-491e-a289-dd6adba2a11b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53612. Sep 09 21:21:04.919697 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-800b04d3-a78a-4067-88d8-520db6a8a76e tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.127100 Sep 09 21:21:04.920318 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 560/1118] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:21:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:07.018466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-871593534", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0801b011-6de8-408c-b234-30930e8ba97f"}], "security_groups": [{"name": "tempest-securitygroup--1854481856"}], "key_name": "tempest-keypair-1996651110", "user_data": "}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:07.121056 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] validate_networks() for [('0801b011-6de8-408c-b234-30930e8ba97f', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:21:07.481646 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:21:07.482090 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:21:07.482574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:21:07.482984 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:21:07.483396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:21:07.491993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:07.492506 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:07.492933 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:07.493655 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:07.494104 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:07.494528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:07.511565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:21:07.515486 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:21:07.526818 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:21:07.529110 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:21:07.686904 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR oslo.messaging._drivers.impl_rabbit [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [53610bf4-cc9a-4e8b-b492-73d16154785b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:21:08.693726 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO oslo.messaging._drivers.impl_rabbit [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [53610bf4-cc9a-4e8b-b492-73d16154785b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 53638. Sep 09 21:21:08.698269 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-309d1c6e-d079-4557-9105-11bc78cbe0e8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.684645 Sep 09 21:21:08.698925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 559/1119] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:21:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:21:08.711637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-0b0162a4-bac4-406c-909f-eeddbf04bbf9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:08.712269 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-0b0162a4-bac4-406c-909f-eeddbf04bbf9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:08.767509 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-0b0162a4-bac4-406c-909f-eeddbf04bbf9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:08.775280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-0b0162a4-bac4-406c-909f-eeddbf04bbf9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1241 microversion: 2.1 time: 0.068874 Sep 09 21:21:08.779448 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 561/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:08 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:09.799308 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:09.799918 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:09.807046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:09.807524 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:09.808139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:09.808828 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:09.809276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:09.809694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:09.873752 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:09.881584 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dc3d992b-dad1-47e9-b5ca-a139d043a0c6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1245 microversion: 2.1 time: 0.086726 Sep 09 21:21:09.882551 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 560/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:09 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:10.103821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-202437159"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:10.104483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:10.110975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:10.111426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:10.111866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:10.112585 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:10.113155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:10.113576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:10.243785 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.network.security_group_api [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Removing security group 3264c306-2688-4856-b927-7f9894848208 from port 69a39d7b-18e5-48b0-b530-5d248c13c509 Sep 09 21:21:10.610531 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b3729356-7a57-4721-9343-5326568c2f1b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/action" status: 202 len: 0 microversion: 2.1 time: 0.511492 Sep 09 21:21:10.611198 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 562/1122] 10.222.0.48 () {60 vars in 1278 bytes} [Fri Sep 9 21:21:10 2022] POST /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:21:10.621192 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-e23d90d8-a40c-43ae-94d9-c59245b3df33 req-8ca80cb2-d71a-4617-a2c2-c8be942d135f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:10.634957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-e23d90d8-a40c-43ae-94d9-c59245b3df33 req-8ca80cb2-d71a-4617-a2c2-c8be942d135f service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:10.635432 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-e23d90d8-a40c-43ae-94d9-c59245b3df33 req-8ca80cb2-d71a-4617-a2c2-c8be942d135f service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:10.636626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-e23d90d8-a40c-43ae-94d9-c59245b3df33 req-8ca80cb2-d71a-4617-a2c2-c8be942d135f service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:10.660567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-e23d90d8-a40c-43ae-94d9-c59245b3df33 req-8ca80cb2-d71a-4617-a2c2-c8be942d135f service nova] Creating event network-changed:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:21:10.666805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-e23d90d8-a40c-43ae-94d9-c59245b3df33 req-8ca80cb2-d71a-4617-a2c2-c8be942d135f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050169 Sep 09 21:21:10.667788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 561/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:10.905424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:10.906469 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:10.916281 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:10.917441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:10.918121 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:10.919201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:10.919860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:10.920504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:11.039454 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:11.062239 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4e231674-ce44-4118-8a3b-3a3852ece6ec tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1301 microversion: 2.1 time: 0.160291 Sep 09 21:21:11.063795 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 563/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:10 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1301 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:12.093184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:12.093889 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:12.100612 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.101166 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.101602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.102805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.103277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.103697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.360597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:12.369857 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3f1a1ae7-5676-487f-8a99-37cd0ed8d97b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.281390 Sep 09 21:21:12.384094 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 562/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:12 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:12.517004 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:12.518168 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:12.525045 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.525728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.526365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.527240 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.527860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.528483 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.619788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lazy-loading 'services' on Instance uuid 06dff183-e600-4ed4-ac42-01ee97d2f8e3 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:21:12.685764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-1e3ebc61-d0f3-49d9-828d-292246ae8647 req-7b1d7ccc-b13a-4a7b-b485-718a10ef4e76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:12.696651 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1e3ebc61-d0f3-49d9-828d-292246ae8647 req-7b1d7ccc-b13a-4a7b-b485-718a10ef4e76 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.697342 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1e3ebc61-d0f3-49d9-828d-292246ae8647 req-7b1d7ccc-b13a-4a7b-b485-718a10ef4e76 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.698012 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-1e3ebc61-d0f3-49d9-828d-292246ae8647 req-7b1d7ccc-b13a-4a7b-b485-718a10ef4e76 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.710087 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-1e3ebc61-d0f3-49d9-828d-292246ae8647 req-7b1d7ccc-b13a-4a7b-b485-718a10ef4e76 service nova] Creating event network-changed:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:21:12.715163 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-1e3ebc61-d0f3-49d9-828d-292246ae8647 req-7b1d7ccc-b13a-4a7b-b485-718a10ef4e76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033233 Sep 09 21:21:12.717919 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 563/1126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:21:12.825196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d196a747-6b45-4ec6-8dd8-d63c1e57a07b tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments/404ef07a-5b57-4bdb-8ee8-f14e1799cfba" status: 202 len: 0 microversion: 2.1 time: 0.312217 Sep 09 21:21:12.825794 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 564/1127] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:21:12 2022] DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments/404ef07a-5b57-4bdb-8ee8-f14e1799cfba => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:21:12.835253 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:12.838870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:12.847472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.847960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.848436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.850908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:12.850908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:12.850908 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:12.881381 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-63dae542-f5c2-4edb-bd7f-9b98d439d48d tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050953 Sep 09 21:21:12.881950 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 564/1128] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:21:12 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:13.395586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:13.396334 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:13.403199 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:13.403679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:13.404157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:13.405064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:13.405551 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:13.405975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:13.582657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:13.590633 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-71885bc1-aa11-414d-8054-e28a380612f9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.199344 Sep 09 21:21:13.591525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 565/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:13 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:13.893294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:13.895684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:13.902751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:13.903306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:13.903815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:13.904611 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:13.905155 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:13.905648 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:13.937962 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c94e6235-cbfd-4a14-9434-382ad99999aa tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Sep 09 21:21:13.938531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 565/1130] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:21:13 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:14.613450 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:14.614094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:14.620451 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:14.620932 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:14.621375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:14.622064 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:14.622523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:14.622948 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:14.626967 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:14.731305 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-687458d3-9e93-401c-b2dc-a15624cad7dc req-56567793-d492-459c-922b-6a89af057e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d96721-0297-4d2d-a598-8a2e0ea2fdb5", "tag": "a75adb89-a7ce-4d55-bd90-d19a67b6a407"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:14.740942 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-687458d3-9e93-401c-b2dc-a15624cad7dc req-56567793-d492-459c-922b-6a89af057e65 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:14.741420 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-687458d3-9e93-401c-b2dc-a15624cad7dc req-56567793-d492-459c-922b-6a89af057e65 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:14.746455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-687458d3-9e93-401c-b2dc-a15624cad7dc req-56567793-d492-459c-922b-6a89af057e65 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:14.753059 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-687458d3-9e93-401c-b2dc-a15624cad7dc req-56567793-d492-459c-922b-6a89af057e65 service nova] Creating event network-changed:a75adb89-a7ce-4d55-bd90-d19a67b6a407 for instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 on hv-cinder-83124 Sep 09 21:21:14.758567 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-687458d3-9e93-401c-b2dc-a15624cad7dc req-56567793-d492-459c-922b-6a89af057e65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 Sep 09 21:21:14.759190 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 566/1131] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:21:14.760208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:14.767764 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-71480c86-ec5c-482d-8c20-e5e22c2a3ecb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.158196 Sep 09 21:21:14.768338 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 566/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:14 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:14.951827 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:14.954069 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:14.960419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:14.960898 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:14.962010 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:14.962723 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:14.963163 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:14.963584 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:14.991091 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b2edf5f1-4a7f-4afa-9e2c-d3c0a3aa55de tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043919 Sep 09 21:21:14.991639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 567/1133] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:21:14 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:21:15.002270 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:15.002761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:15.009728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:15.010202 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:15.010631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:15.011314 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:15.011761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:15.012205 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:15.085561 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] HTTP exception thrown: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 is not attached to volume 404ef07a-5b57-4bdb-8ee8-f14e1799cfba Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Request method failure captured: Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments/404ef07a-5b57-4bdb-8ee8-f14e1799cfba HTTP/1.1 Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG62NAQ_bE_49Ig3wjkb5CbGsyO0k8LOkNlGec5nZGxq2VVIRqy4RhdCAK8ZMwPKbCYxxTcykaUw8YE7tg6lyZK6m7TzhSgrE1NMwC9kOhlLxECj5NxBZ4OKPzz2UDiP5UrEQyVS5z8jYmfodfWPq_O7qLFYlkm8x-zaRAB5JVGCRoNY Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: a1261e5e82414293b96ce77482498a89 Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-TestMinimumBasicScenario-1431697123 Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:21:15.088461 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1261e5e82414293b96ce77482498a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1261e5e82414293b96ce77482498a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1261e5e82414293b96ce77482498a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1261e5e82414293b96ce77482498a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-TestMinimumBasicScenario-1431697123 Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: a1261e5e82414293b96ce77482498a89 Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1431697123 Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-TestMinimumBasicScenario-1431697123-project Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: fa04bcfffac2473baad2953f1c64eb95 Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-TestMinimumBasicScenario-1431697123-project Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:21:15.090200 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 is not attached to volume 404ef07a-5b57-4bdb-8ee8-f14e1799cfba Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'server_id': '06dff183-e600-4ed4-ac42-01ee97d2f8e3', 'id': '404ef07a-5b57-4bdb-8ee8-f14e1799cfba'} Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 404ef07a-5b57-4bdb-8ee8-f14e1799cfba. Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:21:15.091306 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 is not attached to volume 404ef07a-5b57-4bdb-8ee8-f14e1799cfba Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 is not attached to volume 404ef07a-5b57-4bdb-8ee8-f14e1799cfba Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:21:15.092906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Returning 404 to user: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 is not attached to volume 404ef07a-5b57-4bdb-8ee8-f14e1799cfba {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:21:15.094105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-ad927b75-e2ce-439b-96bc-65149fd8b027 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments/404ef07a-5b57-4bdb-8ee8-f14e1799cfba" status: 404 len: 154 microversion: 2.1 time: 0.091817 Sep 09 21:21:15.094105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 567/1134] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:21:14 2022] DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3/os-volume_attachments/404ef07a-5b57-4bdb-8ee8-f14e1799cfba => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:21:15.791245 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:15.791856 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:15.797745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:15.798222 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:15.798684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:15.799370 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:15.799820 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:15.800271 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:15.818240 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=100 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:15.931697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:15.939334 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-213dedcb-48d2-4c12-9a42-02deddab96dc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.152511 Sep 09 21:21:15.939895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 568/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:15 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:16.370154 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:16.370722 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:16.376917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:16.377392 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:16.377819 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:16.378502 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:16.378946 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:16.379364 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:16.404463 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:21:16.642085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4fdb7a57-bff6-4fec-af4c-5db356e35b51 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 204 len: 0 microversion: 2.1 time: 0.276388 Sep 09 21:21:16.642678 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 568/1136] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:21:16 2022] DELETE /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:21:16.651906 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:16.652637 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:16.661180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:16.661743 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:16.662184 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:16.662886 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:16.663333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:16.663751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:16.789559 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:16.797793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d4a8cf2b-f192-4f05-8b09-2f0c610bf632 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1553 microversion: 2.1 time: 0.150781 Sep 09 21:21:16.798362 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 569/1137] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:16 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:16.963830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:16.964568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:16.970396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:16.970874 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:16.971307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:16.971993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:16.972501 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:16.972925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:17.104097 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:17.111636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b80a48be-c77c-4ef1-9d5d-c7bd5524b726 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.152766 Sep 09 21:21:17.112225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 569/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:16 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:17.820426 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:17.821033 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:17.823012 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:17.823670 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:17.828936 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:17.829416 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:17.829854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:17.830545 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:17.830994 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:17.831419 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:17.955320 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:17.963158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-470e9c0b-5b66-4c28-9e87-ba148367973e tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1553 microversion: 2.1 time: 0.146664 Sep 09 21:21:17.963719 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 570/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:17 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:18.134545 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:18.135105 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:18.141420 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:18.141897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:18.142322 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:18.143005 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:18.143479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:18.143897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:18.268895 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:18.276841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-024c2404-02f8-41ea-9d35-dcb4d97ee242 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.146270 Sep 09 21:21:18.277387 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 570/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:18 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:18.986584 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:18.987154 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:18.994418 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:18.995215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:18.995846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:18.997379 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:18.998029 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:18.998924 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:19.139793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:19.147682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-63d97a54-4e0c-4795-a4c6-f568890bc1ca tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1553 microversion: 2.1 time: 0.165232 Sep 09 21:21:19.148280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 571/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:18 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:19.258693 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-58af07f9-fcdf-434e-a86b-f2ed7349fa05 req-ab514915-3181-4e22-b002-e9e14364a0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06dff183-e600-4ed4-ac42-01ee97d2f8e3", "name": "network-vif-deleted", "tag": "69a39d7b-18e5-48b0-b530-5d248c13c509"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:19.263891 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:19.269663 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-58af07f9-fcdf-434e-a86b-f2ed7349fa05 req-ab514915-3181-4e22-b002-e9e14364a0ae service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:19.270150 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-58af07f9-fcdf-434e-a86b-f2ed7349fa05 req-ab514915-3181-4e22-b002-e9e14364a0ae service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:19.270587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-58af07f9-fcdf-434e-a86b-f2ed7349fa05 req-ab514915-3181-4e22-b002-e9e14364a0ae service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:19.281385 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-58af07f9-fcdf-434e-a86b-f2ed7349fa05 req-ab514915-3181-4e22-b002-e9e14364a0ae service nova] Creating event network-vif-deleted:69a39d7b-18e5-48b0-b530-5d248c13c509 for instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 on hv-cinder-83124 Sep 09 21:21:19.286146 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-58af07f9-fcdf-434e-a86b-f2ed7349fa05 req-ab514915-3181-4e22-b002-e9e14364a0ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031198 Sep 09 21:21:19.286724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 571/1142] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:19.300389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:19.301001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:19.302903 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:19.310403 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:19.310880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:19.311350 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:19.312045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:19.312515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:19.313208 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:19.447403 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:19.455697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a7c5a56d-aff9-4cbc-ae53-6aa273b0ec32 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.159198 Sep 09 21:21:19.468294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 572/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:19 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:20.171525 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:20.172275 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:20.174492 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:21:20.179268 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:20.181565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:20.181565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:20.181565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:20.181945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:20.182366 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:20.214472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:20.214968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:20.215383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:20.215832 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lazy-loading 'fault' on Instance uuid 06dff183-e600-4ed4-ac42-01ee97d2f8e3 {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:21:20.259813 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa04bcfffac2473baad2953f1c64eb95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1261e5e82414293b96ce77482498a89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:20.270202 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b8dcf94a-98f7-443d-a636-256df2f23af8 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 200 len: 1347 microversion: 2.1 time: 0.100761 Sep 09 21:21:20.270202 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 572/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:20 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:20.480063 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:20.480694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:20.488000 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:20.488514 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:20.488944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:20.489626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:20.490070 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:20.490529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:20.617868 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:20.625399 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3f56773d-238f-4e5d-a875-86ce85200567 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.150158 Sep 09 21:21:20.625952 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 573/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:20 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:21.015201 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-7f85f8bb-e6a7-4754-ac60-513c2f825206 req-d6b41c28-a4d9-4eb6-861a-225c2b6defbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d96721-0297-4d2d-a598-8a2e0ea2fdb5", "name": "network-vif-plugged", "status": "completed", "tag": "a75adb89-a7ce-4d55-bd90-d19a67b6a407"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:21.025836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7f85f8bb-e6a7-4754-ac60-513c2f825206 req-d6b41c28-a4d9-4eb6-861a-225c2b6defbf service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:21.026404 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7f85f8bb-e6a7-4754-ac60-513c2f825206 req-d6b41c28-a4d9-4eb6-861a-225c2b6defbf service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:21.026830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7f85f8bb-e6a7-4754-ac60-513c2f825206 req-d6b41c28-a4d9-4eb6-861a-225c2b6defbf service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:21.039214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-7f85f8bb-e6a7-4754-ac60-513c2f825206 req-d6b41c28-a4d9-4eb6-861a-225c2b6defbf service nova] Creating event network-vif-plugged:a75adb89-a7ce-4d55-bd90-d19a67b6a407 for instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 on hv-cinder-83124 Sep 09 21:21:21.044221 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-7f85f8bb-e6a7-4754-ac60-513c2f825206 req-d6b41c28-a4d9-4eb6-861a-225c2b6defbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 Sep 09 21:21:21.044814 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 573/1146] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:21.290854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:21.291466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] [instance: 06dff183-e600-4ed4-ac42-01ee97d2f8e3] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:21.297468 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:21.297954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:21.298387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:21.299079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:21.299531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:21.299956 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:21.314088 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] HTTP exception thrown: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 could not be found. Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Request method failure captured: Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 HTTP/1.1 Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG62NAQ_bE_49Ig3wjkb5CbGsyO0k8LOkNlGec5nZGxq2VVIRqy4RhdCAK8ZMwPKbCYxxTcykaUw8YE7tg6lyZK6m7TzhSgrE1NMwC9kOhlLxECj5NxBZ4OKPzz2UDiP5UrEQyVS5z8jYmfodfWPq_O7qLFYlkm8x-zaRAB5JVGCRoNY Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: a1261e5e82414293b96ce77482498a89 Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-TestMinimumBasicScenario-1431697123 Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:21:21.315811 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1261e5e82414293b96ce77482498a89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1261e5e82414293b96ce77482498a89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1261e5e82414293b96ce77482498a89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1261e5e82414293b96ce77482498a89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-TestMinimumBasicScenario-1431697123 Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: a1261e5e82414293b96ce77482498a89 Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1431697123 Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-TestMinimumBasicScenario-1431697123-project Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: fa04bcfffac2473baad2953f1c64eb95 Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-TestMinimumBasicScenario-1431697123-project Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 could not be found. Sep 09 21:21:21.317533 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '06dff183-e600-4ed4-ac42-01ee97d2f8e3'} Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 could not be found. Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:21:21.318721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 could not be found. Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 could not be found. Sep 09 21:21:21.320504 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:21:21.322015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Returning 404 to user: Instance 06dff183-e600-4ed4-ac42-01ee97d2f8e3 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:21:21.322015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9925c5fd-d3a1-4137-9864-2d92207fee54 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3" status: 404 len: 111 microversion: 2.1 time: 0.030409 Sep 09 21:21:21.322015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 574/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:21 2022] GET /compute/v2.1/servers/06dff183-e600-4ed4-ac42-01ee97d2f8e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:21:21.327812 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4a0d8941-9692-429f-9d3d-f1afa5f7d0d7 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] Calling method '.version_select at 0x7fa1d0b498b0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:21.408748 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4a0d8941-9692-429f-9d3d-f1afa5f7d0d7 tempest-TestMinimumBasicScenario-1431697123 tempest-TestMinimumBasicScenario-1431697123-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-627116112" status: 202 len: 0 microversion: 2.1 time: 0.086169 Sep 09 21:21:21.409430 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 574/1148] 10.222.0.48 () {58 vars in 1269 bytes} [Fri Sep 9 21:21:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-627116112 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:21:21.649001 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:21.649758 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:21.656316 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:21.656808 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:21.657243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:21.657944 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:21.658397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:21.659210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:21.788763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:21.797367 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-02acbb30-b0c4-42d4-9ab7-6b0b58a54449 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.152893 Sep 09 21:21:21.801711 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 575/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:21 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:22.820353 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:22.821089 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:22.827341 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:22.827819 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:22.828294 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:22.828987 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:22.829429 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:22.829848 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:23.044815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:23.052424 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d3d7248e-d2ee-4cae-8183-d57b23f9fbe8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1367 microversion: 2.1 time: 0.235892 Sep 09 21:21:23.052978 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 575/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:22 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:24.075034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:24.076175 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:24.082267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:24.082759 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:24.083193 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:24.084449 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:24.084960 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:24.085332 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:24.295870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:21:24.303895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f6f1307c-9888-482a-95ee-37d6ae78af9f tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1557 microversion: 2.1 time: 0.232882 Sep 09 21:21:24.306193 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 576/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:21:24 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:21:24.327346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:21:24.328508 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:21:24.335484 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:24.335908 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:24.336360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:24.337094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:24.337540 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:24.338470 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:24.452436 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d7e2ecae-e4ed-412d-b5f3-448a1c30fd68 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129630 Sep 09 21:21:24.453596 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 576/1152] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:21:24 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:21:25.902252 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-c9343991-1b4f-426e-be3e-0174c9fbf859 req-a8305e36-03fc-4bd2-a29b-617caa12a4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97d96721-0297-4d2d-a598-8a2e0ea2fdb5", "tag": "a75adb89-a7ce-4d55-bd90-d19a67b6a407"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:21:25.920566 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-c9343991-1b4f-426e-be3e-0174c9fbf859 req-a8305e36-03fc-4bd2-a29b-617caa12a4ef service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:21:25.925429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-c9343991-1b4f-426e-be3e-0174c9fbf859 req-a8305e36-03fc-4bd2-a29b-617caa12a4ef service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:21:25.925429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-c9343991-1b4f-426e-be3e-0174c9fbf859 req-a8305e36-03fc-4bd2-a29b-617caa12a4ef service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:21:25.935809 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-c9343991-1b4f-426e-be3e-0174c9fbf859 req-a8305e36-03fc-4bd2-a29b-617caa12a4ef service nova] Creating event network-changed:a75adb89-a7ce-4d55-bd90-d19a67b6a407 for instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 on hv-cinder-83124 Sep 09 21:21:25.953682 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-c9343991-1b4f-426e-be3e-0174c9fbf859 req-a8305e36-03fc-4bd2-a29b-617caa12a4ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055660 Sep 09 21:21:25.959910 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 577/1153] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:22:30.687804 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:30.688614 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:30.689361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:22:30.689523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Fri Sep 9 21:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/ips (ip 10.222.0.48) !!! Sep 09 21:22:30.917854 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:30.918383 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:30.924293 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:30.924771 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:30.925204 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:30.925892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:30.926340 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:30.926761 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:30.949782 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6060e98e-c8ee-4710-8727-f27ca78097e4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/ips" status: 200 len: 150 microversion: 2.1 time: 0.263990 Sep 09 21:22:30.951012 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 577/1154] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:22:30 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/ips => generated 150 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:22:33.656161 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=11 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:33.656930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=48 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:33.661916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb7909cc-6ecd-4bcd-a6ce-1022a698aa68"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:22:33.664439 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:33.671210 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:33.678408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:33.678408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:33.678408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:33.678408 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:33.678816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:34.483971 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9c9945e6-fa13-41b5-89ec-95c4e66bb6f6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829446 Sep 09 21:22:34.484626 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 578/1155] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:22:33 2022] POST /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:22:42.012637 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb7909cc-6ecd-4bcd-a6ce-1022a698aa68"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:22:42.015504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:42.017799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:42.018465 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=4 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:22:42.023223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:42.023706 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:42.024165 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:42.024866 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:42.025523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:42.026157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:42.108426 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Invalid volume: volume fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 is already attached to instances: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: POST /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments HTTP/1.1 Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 74 Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:22:42.110172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {"volumeAttachment": {"volumeId": "fb7909cc-6ecd-4bcd-a6ce-1022a698aa68"}} Sep 09 21:22:42.112100 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Invalid volume: volume fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 is already attached to instances: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'server_id': '97d96721-0297-4d2d-a598-8a2e0ea2fdb5', 'body': {'volumeAttachment': {'volumeId': 'fb7909cc-6ecd-4bcd-a6ce-1022a698aa68'}}} Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 is already attached to instances: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:42.113406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 is already attached to instances: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:22:42.115090 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 is already attached to instances: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 400 to user: Invalid volume: volume fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 is already attached to instances: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-291b7954-b602-410f-b8ff-b579d616e995 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103152 Sep 09 21:22:42.116830 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 578/1156] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:22:42 2022] POST /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 21:22:42.177430 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:42.178021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:42.184045 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:42.184558 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:42.184995 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:42.185684 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:42.186136 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:42.186560 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:42.265539 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'services' on Instance uuid 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:22:42.494215 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e1f9055a-354d-470f-b58b-612ce27ce822 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments/fb7909cc-6ecd-4bcd-a6ce-1022a698aa68" status: 202 len: 0 microversion: 2.1 time: 0.321145 Sep 09 21:22:42.494735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 579/1157] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:22:42 2022] DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments/fb7909cc-6ecd-4bcd-a6ce-1022a698aa68 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:22:42.503160 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:42.505454 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:42.512516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:42.513444 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:42.513902 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:42.514573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:42.515025 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:42.515472 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:42.544371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2a3f36a4-fee2-42f0-a933-1e3e4d5aeb2d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Sep 09 21:22:42.544923 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 579/1158] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:22:42 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:22:43.556930 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:43.559171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:43.565421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:43.565902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:43.566331 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:43.567028 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:43.567472 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:43.567892 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:43.597829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3b35b67c-a898-4606-ba3e-1ed549cc148b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045677 Sep 09 21:22:43.598376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 580/1159] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:22:43 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:22:43.660575 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:43.661113 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:43.667558 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:43.668026 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:43.668487 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:43.669757 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:43.670202 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:43.670620 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:43.694710 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:22:43.977361 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-71f2de8e-72f0-46a6-89d9-2c751a5cb020 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 204 len: 0 microversion: 2.1 time: 0.320208 Sep 09 21:22:43.977931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 580/1160] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:22:43 2022] DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:22:43.986475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:43.987270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:43.993565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:43.994049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:43.994485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:43.995185 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:43.995643 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:43.996093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:44.132787 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:44.140943 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d9277356-8151-4442-a538-f29d3cba8f5a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1682 microversion: 2.1 time: 0.158553 Sep 09 21:22:44.141505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 581/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:43 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 21:22:45.165297 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:45.165995 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:45.172892 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:45.173371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:45.173796 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:45.174473 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:45.174917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:45.175337 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:45.314574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:45.322406 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a137184f-e313-4e1d-9c83-d9e164bd7c65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1682 microversion: 2.1 time: 0.161351 Sep 09 21:22:45.322968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 581/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:45 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:46.346602 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:46.347170 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:46.353429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:46.353903 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:46.354333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:46.355023 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:46.355499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:46.355915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:46.489293 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:46.496815 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-32a12a11-fc26-4e7b-9c58-aa1a912cecfd tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1682 microversion: 2.1 time: 0.154302 Sep 09 21:22:46.498365 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 582/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:46 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:46.947718 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-7ed684dc-1f7b-44b4-8d9d-262a028e214c req-121ce490-50e9-42b8-a2cc-1e9a4983e4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97d96721-0297-4d2d-a598-8a2e0ea2fdb5", "name": "network-vif-deleted", "tag": "a75adb89-a7ce-4d55-bd90-d19a67b6a407"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:22:46.962666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7ed684dc-1f7b-44b4-8d9d-262a028e214c req-121ce490-50e9-42b8-a2cc-1e9a4983e4fa service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:46.962666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7ed684dc-1f7b-44b4-8d9d-262a028e214c req-121ce490-50e9-42b8-a2cc-1e9a4983e4fa service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:46.962666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-7ed684dc-1f7b-44b4-8d9d-262a028e214c req-121ce490-50e9-42b8-a2cc-1e9a4983e4fa service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:46.970713 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-7ed684dc-1f7b-44b4-8d9d-262a028e214c req-121ce490-50e9-42b8-a2cc-1e9a4983e4fa service nova] Creating event network-vif-deleted:a75adb89-a7ce-4d55-bd90-d19a67b6a407 for instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 on hv-cinder-83124 Sep 09 21:22:46.975775 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-7ed684dc-1f7b-44b4-8d9d-262a028e214c req-121ce490-50e9-42b8-a2cc-1e9a4983e4fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094537 Sep 09 21:22:46.976398 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 582/1164] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:22:47.519848 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:47.520505 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:47.528095 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:47.528616 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:47.529056 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:47.529763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:47.530212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:47.530633 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:47.562610 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:47.563093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:47.563531 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:47.563980 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'fault' on Instance uuid 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:22:47.604219 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:47.612402 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9c9f1916-e4ca-4d8a-a57c-e51a19a9711c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 200 len: 1331 microversion: 2.1 time: 0.096388 Sep 09 21:22:47.612968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 583/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:47 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:48.638258 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:48.638883 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:48.644900 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:48.645371 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:48.645799 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:48.646477 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:48.646922 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:48.647346 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:48.660172 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 HTTP/1.1 Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:22:48.661746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:22:48.663427 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '97d96721-0297-4d2d-a598-8a2e0ea2fdb5'} Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:22:48.664336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:22:48.666224 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:22:48.667657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:22:48.667657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c097b78c-e58b-49c6-86c4-7a5d00c38ade tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 404 len: 111 microversion: 2.1 time: 0.029686 Sep 09 21:22:48.667657 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 583/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:48 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:22:48.672377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-53ad0d94-f811-448e-baeb-899dc39a83d8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '.version_select at 0x7fa1d0c09ee0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:48.766764 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-53ad0d94-f811-448e-baeb-899dc39a83d8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996651110" status: 202 len: 0 microversion: 2.1 time: 0.098687 Sep 09 21:22:48.767375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 584/1167] 10.222.0.48 () {58 vars in 1221 bytes} [Fri Sep 9 21:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996651110 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:22:49.524128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-f2b7c7a3-40bd-4bf9-8a24-e7551f052d11 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: .version_select at 0x7fa1d0ae8dc0>, body: {"keypair": {"name": "tempest-keypair-779814292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2+DSPyHkfCy3weXBRnUPU4F3VXCVpSphWYKziCRucdTmu5sn51ujPA7vtotWOzu+LpAZugzOjfsue7O19Xpz+xrUr0w4/dFilyc7ViV6SaPiNb5TJdxHZe81Xq7Tcy1Q=="}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:22:49.539227 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-f2b7c7a3-40bd-4bf9-8a24-e7551f052d11 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:22:49.542945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.quota [None req-f2b7c7a3-40bd-4bf9-8a24-e7551f052d11 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'key_pairs'} {{(pid=121137) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:22:49.624557 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-f2b7c7a3-40bd-4bf9-8a24-e7551f052d11 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104417 Sep 09 21:22:49.625140 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 584/1168] 10.222.0.48 () {60 vars in 1159 bytes} [Fri Sep 9 21:22:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:22:51.674356 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-823049093", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0801b011-6de8-408c-b234-30930e8ba97f"}], "security_groups": [{"name": "tempest-securitygroup--122368655"}], "key_name": "tempest-keypair-779814292", "user_data": "}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:22:51.776144 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] validate_networks() for [('0801b011-6de8-408c-b234-30930e8ba97f', None, None, None, None, None)] {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:22:52.379776 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:22:52.380243 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:22:52.380721 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:22:52.381131 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:22:52.381572 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:22:52.390189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:52.390667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:52.391101 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:52.391829 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:52.392311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:52.392736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:52.409270 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:22:52.413178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Getting quotas for user 56e50c46ac774417a50af986c5f87420 and project 1a518e979c944b3ab2a1245b3cfd246f. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:22:52.424309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:22:52.426548 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:22:52.558179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-c8e24e34-d7f5-4147-85da-3b6b0289eb6c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.888645 Sep 09 21:22:52.558737 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 585/1169] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:22:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:22:52.570636 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-28a69d7b-10b3-4fa9-be4a-a7c8f281f7f7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:52.571285 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-28a69d7b-10b3-4fa9-be4a-a7c8f281f7f7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:52.626077 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-28a69d7b-10b3-4fa9-be4a-a7c8f281f7f7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:52.632825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-28a69d7b-10b3-4fa9-be4a-a7c8f281f7f7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1240 microversion: 2.1 time: 0.066854 Sep 09 21:22:52.633382 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 585/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:52 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:53.656206 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:53.657597 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:53.664613 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:53.665109 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:53.665583 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:53.666244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:53.666686 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:53.667102 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:53.732939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:53.740517 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5eaad092-902b-4243-9b9e-e767d774dae8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1244 microversion: 2.1 time: 0.088984 Sep 09 21:22:53.741107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 586/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:53 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:54.764679 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:54.769425 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:54.771838 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:54.772351 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:54.772786 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:54.773479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:54.773927 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:54.774348 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:54.847155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:54.855993 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7abd657e-da39-42f2-a371-eaab85ad330d tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1300 microversion: 2.1 time: 0.095868 Sep 09 21:22:54.856631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 586/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:54 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:55.880641 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:55.881291 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:55.888222 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:55.888782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:55.889225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:55.889925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:55.890377 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:55.890804 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:56.017893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:56.025466 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-8ec36dc2-2d45-401e-beb5-a3372ec2b570 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.148794 Sep 09 21:22:56.026034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 587/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:55 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:56.521763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-710cb3b3-a265-4d38-8539-0ff950779583 req-1660152a-1b53-440c-a4fd-c91e4bf3494e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95804c8c-8bb3-401d-8313-3e1e17531b2d", "tag": "e51de32a-ad39-4cfc-a549-f58345d2789f"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:22:56.531644 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-710cb3b3-a265-4d38-8539-0ff950779583 req-1660152a-1b53-440c-a4fd-c91e4bf3494e service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:56.532190 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-710cb3b3-a265-4d38-8539-0ff950779583 req-1660152a-1b53-440c-a4fd-c91e4bf3494e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:56.532576 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-710cb3b3-a265-4d38-8539-0ff950779583 req-1660152a-1b53-440c-a4fd-c91e4bf3494e service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:56.543196 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-710cb3b3-a265-4d38-8539-0ff950779583 req-1660152a-1b53-440c-a4fd-c91e4bf3494e service nova] Creating event network-changed:e51de32a-ad39-4cfc-a549-f58345d2789f for instance 95804c8c-8bb3-401d-8313-3e1e17531b2d on hv-cinder-83124 Sep 09 21:22:56.548143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-710cb3b3-a265-4d38-8539-0ff950779583 req-1660152a-1b53-440c-a4fd-c91e4bf3494e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030146 Sep 09 21:22:56.548728 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 587/1174] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:22:57.049025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:57.052515 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:57.055883 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:57.056387 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:57.056820 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:57.057508 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:57.057954 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:57.058372 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:57.188385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:57.196098 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-e93c7f06-102b-4058-a212-a72e79ee76e6 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.150888 Sep 09 21:22:57.196745 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 588/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:57 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:58.220417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:58.221110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:58.227152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:58.227629 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:58.228060 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:58.228763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:58.229211 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:58.229631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:58.353906 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:58.361396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b204d2ef-2c0c-4f2b-b696-f4c652740295 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.146238 Sep 09 21:22:58.361950 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 588/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:58 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:22:59.384181 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:22:59.384748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:22:59.391816 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:59.392325 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:59.392763 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:59.393456 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:22:59.394285 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:22:59.394463 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:22:59.522494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:22:59.530066 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-caf2bc13-059b-42ad-b188-03fe813b6eb3 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.149844 Sep 09 21:22:59.530625 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 589/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:22:59 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:00.551975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:00.552670 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:00.559037 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:00.559516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:00.559951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:00.560674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:00.561128 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:00.561556 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:00.698419 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:23:00.706586 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-121c6da4-7a17-437e-8ec1-f3c5abf7aa3b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.158575 Sep 09 21:23:00.707141 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 589/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:23:00 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:01.729425 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:01.730046 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:01.736825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:01.737306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:01.737770 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:01.738463 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:01.738966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:01.739389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:01.864656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:23:01.872762 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-dbe88106-6256-4df9-bc12-56f44808e46c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.147308 Sep 09 21:23:01.873331 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 590/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:23:01 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:02.895860 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:02.896500 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:02.898924 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=6 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:02.904520 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:02.905013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:02.905455 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:02.906190 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:02.906587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:02.907009 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:03.038821 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:23:03.046486 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-be639269-1064-441f-bcba-9ced8bd8f775 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.154546 Sep 09 21:23:03.047048 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 590/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:23:02 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:03.420742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-b989b72c-cac8-4047-b032-d6dadc467ad1 req-981acd3a-20ac-4b5b-b421-645c5d23000d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95804c8c-8bb3-401d-8313-3e1e17531b2d", "name": "network-vif-plugged", "status": "completed", "tag": "e51de32a-ad39-4cfc-a549-f58345d2789f"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:23:03.427774 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:03.428878 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:03.435785 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b989b72c-cac8-4047-b032-d6dadc467ad1 req-981acd3a-20ac-4b5b-b421-645c5d23000d service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:03.436311 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b989b72c-cac8-4047-b032-d6dadc467ad1 req-981acd3a-20ac-4b5b-b421-645c5d23000d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:03.436736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-b989b72c-cac8-4047-b032-d6dadc467ad1 req-981acd3a-20ac-4b5b-b421-645c5d23000d service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:03.447574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-b989b72c-cac8-4047-b032-d6dadc467ad1 req-981acd3a-20ac-4b5b-b421-645c5d23000d service nova] Creating event network-vif-plugged:e51de32a-ad39-4cfc-a549-f58345d2789f for instance 95804c8c-8bb3-401d-8313-3e1e17531b2d on hv-cinder-83124 Sep 09 21:23:03.452748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-b989b72c-cac8-4047-b032-d6dadc467ad1 req-981acd3a-20ac-4b5b-b421-645c5d23000d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036823 Sep 09 21:23:03.453360 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 591/1181] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:23:04.069731 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:04.070342 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:04.077208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:04.079257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:04.079257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:04.079257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:04.079257 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:04.079726 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:04.205208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:23:04.213133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-201f0532-ea8e-405e-8ec3-1d3e7b02b301 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.147330 Sep 09 21:23:04.213694 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 591/1182] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:23:04 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:05.237664 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:05.238285 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:05.240698 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:05.246107 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:05.253272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:05.253272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:05.253272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:05.253272 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:05.253683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:05.253683 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:23:05.381429 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:23:05.389805 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f4300179-5978-46e4-9db7-8ba593a29f43 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1365 microversion: 2.1 time: 0.157014 Sep 09 21:23:05.390375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 592/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:23:05 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:06.411874 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:06.412526 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:06.418945 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:06.419413 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:06.419840 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:06.420541 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:06.420988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:06.421405 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:06.544935 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:23:06.552703 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6d047e6a-f09b-436b-a65a-cef5b1478929 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1555 microversion: 2.1 time: 0.144729 Sep 09 21:23:06.553263 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 592/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:23:06 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:23:06.575351 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:23:06.575876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:23:06.582312 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:06.582788 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:06.583225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:06.583917 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:06.584398 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:06.584823 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:06.664598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ae9adc90-3942-4b48-886d-a6df998c1e6a tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093980 Sep 09 21:23:06.665189 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 593/1185] 10.222.0.48 () {58 vars in 1275 bytes} [Fri Sep 9 21:23:06 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:23:07.723089 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-72d4bc8d-61b8-4df3-8834-00b22e914ad0 req-e3611ebe-631a-4d21-9c72-4bb06ad63afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95804c8c-8bb3-401d-8313-3e1e17531b2d", "tag": "e51de32a-ad39-4cfc-a549-f58345d2789f"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:23:07.732931 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-72d4bc8d-61b8-4df3-8834-00b22e914ad0 req-e3611ebe-631a-4d21-9c72-4bb06ad63afc service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:23:07.733396 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-72d4bc8d-61b8-4df3-8834-00b22e914ad0 req-e3611ebe-631a-4d21-9c72-4bb06ad63afc service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:23:07.733815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-72d4bc8d-61b8-4df3-8834-00b22e914ad0 req-e3611ebe-631a-4d21-9c72-4bb06ad63afc service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:23:07.744925 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-72d4bc8d-61b8-4df3-8834-00b22e914ad0 req-e3611ebe-631a-4d21-9c72-4bb06ad63afc service nova] Creating event network-changed:e51de32a-ad39-4cfc-a549-f58345d2789f for instance 95804c8c-8bb3-401d-8313-3e1e17531b2d on hv-cinder-83124 Sep 09 21:23:07.750170 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-72d4bc8d-61b8-4df3-8834-00b22e914ad0 req-e3611ebe-631a-4d21-9c72-4bb06ad63afc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084998 Sep 09 21:23:07.751052 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 593/1186] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:20.831888 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=3 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:20.833024 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=9 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:20.838195 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:20.842761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:20.845013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:20.845484 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:20.845913 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:20.846595 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:20.847039 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:20.847455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:20.873182 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-7b4f1916-3d47-47a8-9fd6-4aebc81bc480 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/ips" status: 200 len: 150 microversion: 2.1 time: 0.043418 Sep 09 21:24:20.873751 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 594/1187] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:24:20 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:23.556489 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:23.557225 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:23.562464 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a097538d-ab8d-49be-99f3-6e36527df228"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:24:23.569215 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:23.571106 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:23.571574 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:23.572000 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:23.572714 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:23.573162 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:23.574199 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:24.327917 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a38e63c5-244f-4b16-9006-3f7f2a103e26 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "POST /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773265 Sep 09 21:24:24.328565 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 594/1188] 10.222.0.48 () {60 vars in 1323 bytes} [Fri Sep 9 21:24:23 2022] POST /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:31.954374 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:31.954912 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:31.957136 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:31.962153 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:31.962632 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:31.963061 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:31.963740 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:31.964238 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:31.964667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:32.057193 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.objects.instance [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'services' on Instance uuid 95804c8c-8bb3-401d-8313-3e1e17531b2d {{(pid=121136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:24:32.243431 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-db21f896-93fb-4eba-9957-7c8af7fb034b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments/a097538d-ab8d-49be-99f3-6e36527df228" status: 202 len: 0 microversion: 2.1 time: 0.293497 Sep 09 21:24:32.244006 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 595/1189] 10.222.0.48 () {58 vars in 1416 bytes} [Fri Sep 9 21:24:31 2022] DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments/a097538d-ab8d-49be-99f3-6e36527df228 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:24:32.254008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:32.256280 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:32.263130 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:32.263609 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:32.264143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:32.264997 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:32.265555 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:32.265991 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:32.296836 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-44d6038e-4ffa-44ab-81b9-0696cf79aeca tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Sep 09 21:24:32.297381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 595/1190] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:24:32 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 21:24:33.310393 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:33.312748 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:33.318817 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:33.322026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:33.322026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:33.322026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:33.322026 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:33.322436 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:33.353343 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-3952626d-2616-428c-b448-b727dc8e856b tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Sep 09 21:24:33.353893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 596/1191] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:24:33 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:34.366007 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:34.368058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:34.375110 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:34.375582 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:34.376008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:34.376707 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:34.377152 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:34.377569 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:34.407735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-708a8075-e104-4714-9094-70d99f1d59fb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045810 Sep 09 21:24:34.408300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 596/1192] 10.222.0.48 () {58 vars in 1302 bytes} [Fri Sep 9 21:24:34 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 21:24:34.470558 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:34.471830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:34.477376 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:34.477859 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:34.478297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:34.478989 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:34.479440 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:34.479861 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:34.504895 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Going to try to terminate instance {{(pid=121136) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:24:34.765196 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-ce7d4b70-e294-40f7-93be-60d7a9b2bfbc tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 204 len: 0 microversion: 2.1 time: 0.298260 Sep 09 21:24:34.765782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 597/1193] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:24:34 2022] DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:24:34.773820 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:34.774519 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:34.780949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:34.781417 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:34.781846 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:34.782523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:34.782968 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:34.783381 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:34.915206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:24:34.922763 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-c61a7e8c-f4af-432c-ae6c-dfcd7a6c8bc4 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1680 microversion: 2.1 time: 0.152728 Sep 09 21:24:34.923320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 597/1194] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:34 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:24:35.946421 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:35.947126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:35.953502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:35.953993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:35.954470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:35.955142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:35.955592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:35.956018 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:36.086220 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:24:36.094807 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-aff3a21c-b89a-42e6-a3ae-0dd4952caeb9 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1680 microversion: 2.1 time: 0.152714 Sep 09 21:24:36.095375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 598/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:35 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:24:37.118278 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:37.119013 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:37.126038 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:37.126516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:37.126949 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:37.127631 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:37.128157 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:37.128527 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:37.264844 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:24:37.272897 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-9f84f127-3fd7-406f-89f7-6f0cc8f596af tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1680 microversion: 2.1 time: 0.158441 Sep 09 21:24:37.273868 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 598/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:37 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:24:37.979580 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-d3a70178-9114-4128-87d4-7d2675000c3f req-d7ca47b3-4c63-4a6e-9c70-4e12411366df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95804c8c-8bb3-401d-8313-3e1e17531b2d", "name": "network-vif-deleted", "tag": "e51de32a-ad39-4cfc-a549-f58345d2789f"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:24:37.990212 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-d3a70178-9114-4128-87d4-7d2675000c3f req-d7ca47b3-4c63-4a6e-9c70-4e12411366df service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:37.990691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-d3a70178-9114-4128-87d4-7d2675000c3f req-d7ca47b3-4c63-4a6e-9c70-4e12411366df service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:37.991113 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-d3a70178-9114-4128-87d4-7d2675000c3f req-d7ca47b3-4c63-4a6e-9c70-4e12411366df service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:38.002620 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-d3a70178-9114-4128-87d4-7d2675000c3f req-d7ca47b3-4c63-4a6e-9c70-4e12411366df service nova] Creating event network-vif-deleted:e51de32a-ad39-4cfc-a549-f58345d2789f for instance 95804c8c-8bb3-401d-8313-3e1e17531b2d on hv-cinder-83124 Sep 09 21:24:38.007663 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-d3a70178-9114-4128-87d4-7d2675000c3f req-d7ca47b3-4c63-4a6e-9c70-4e12411366df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031678 Sep 09 21:24:38.008949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 599/1197] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:38.295951 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:38.296523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:38.302839 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:38.303317 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:38.303745 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:38.304460 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:38.304944 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:38.305336 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:38.344044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:38.344533 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:38.344961 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:38.347535 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.objects.instance [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lazy-loading 'fault' on Instance uuid 95804c8c-8bb3-401d-8313-3e1e17531b2d {{(pid=121137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 21:24:38.388184 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56e50c46ac774417a50af986c5f87420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a518e979c944b3ab2a1245b3cfd246f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:24:38.396058 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-4d5ce2c3-e8cb-44bb-9287-f0915d5a3ca7 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 200 len: 1330 microversion: 2.1 time: 0.104168 Sep 09 21:24:38.396673 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 599/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:38 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:24:39.422388 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:39.423130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:39.429213 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:39.429691 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:39.430130 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:39.430822 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:39.431264 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:39.431681 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:39.444972 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d HTTP/1.1 Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:24:39.446608 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:39.448494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '95804c8c-8bb3-401d-8313-3e1e17531b2d'} Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:39.449507 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:39.451529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:39.452915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:39.452915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-213c92af-d2ff-4f98-b661-08610df3cbae tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 404 len: 111 microversion: 2.1 time: 0.030395 Sep 09 21:24:39.452915 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 600/1199] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:39 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:39.458138 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b0297ba0-9770-4c2e-9590-9a74d6139376 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '.version_select at 0x7fa1d0ba13a0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:39.536809 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b0297ba0-9770-4c2e-9590-9a74d6139376 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-779814292" status: 202 len: 0 microversion: 2.1 time: 0.082426 Sep 09 21:24:39.537360 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 600/1200] 10.222.0.48 () {58 vars in 1218 bytes} [Fri Sep 9 21:24:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-779814292 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:24:41.564793 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:41.565294 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:41.571557 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:41.572034 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:41.572499 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:41.573187 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:41.573638 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:41.574065 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:41.587485 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d HTTP/1.1 Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:24:41.589076 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.590860 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '95804c8c-8bb3-401d-8313-3e1e17531b2d'} Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:41.591838 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.593434 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.595021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:41.595021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-398a87e9-8e77-4351-8ddb-7562640985bb tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 404 len: 111 microversion: 2.1 time: 0.029424 Sep 09 21:24:41.595021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 601/1201] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:24:41 2022] DELETE /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:41.599263 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:41.599880 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 95804c8c-8bb3-401d-8313-3e1e17531b2d] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:41.606878 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:41.607359 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:41.607791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:41.608542 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:41.608999 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:41.609423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:41.622705 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d HTTP/1.1 Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:24:41.624365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.626006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '95804c8c-8bb3-401d-8313-3e1e17531b2d'} Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:41.626920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. Sep 09 21:24:41.628300 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:41.629504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 95804c8c-8bb3-401d-8313-3e1e17531b2d could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:41.629504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e393065c-d3e5-42a5-9bb2-4b95d1e421a5 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d" status: 404 len: 111 microversion: 2.1 time: 0.030869 Sep 09 21:24:41.629504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 601/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:41 2022] GET /compute/v2.1/servers/95804c8c-8bb3-401d-8313-3e1e17531b2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:42.901885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:42.902390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:42.908916 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:42.909395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:42.909830 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:42.910520 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:42.910968 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:42.911389 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:42.924347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 HTTP/1.1 Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:24:42.925874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.927652 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '97d96721-0297-4d2d-a598-8a2e0ea2fdb5'} Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:42.928825 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.930511 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.932120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:42.932120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-6cdccafe-f148-40cf-8165-26502c953871 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 404 len: 111 microversion: 2.1 time: 0.029248 Sep 09 21:24:42.932120 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 602/1203] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:24:42 2022] DELETE /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 21:24:42.935947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:42.936589 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 97d96721-0297-4d2d-a598-8a2e0ea2fdb5] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:42.942840 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:42.943320 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:42.943751 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:42.944478 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:42.944960 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:42.945384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:42.959145 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 HTTP/1.1 Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:24:42.960717 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.962674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '97d96721-0297-4d2d-a598-8a2e0ea2fdb5'} Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:42.963523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. Sep 09 21:24:42.964979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.966191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 97d96721-0297-4d2d-a598-8a2e0ea2fdb5 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:42.966191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-92fe6530-7e54-41a3-8d74-0fa2538c6865 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5" status: 404 len: 111 microversion: 2.1 time: 0.030719 Sep 09 21:24:42.966191 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 602/1204] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:42 2022] GET /compute/v2.1/servers/97d96721-0297-4d2d-a598-8a2e0ea2fdb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:42.970694 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:42.971192 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:42.977205 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:42.977766 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:42.978158 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:42.978850 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:42.979306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:42.979736 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:42.993435 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 HTTP/1.1 Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:24:42.994975 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:42.996753 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': 'd395dce9-8a04-4f12-abfb-12246ee5f1d6'} Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:42.998211 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:42.999561 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:43.000957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:43.000957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d1467623-378e-4ffb-adeb-7cb9c4fa239c tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 404 len: 111 microversion: 2.1 time: 0.029529 Sep 09 21:24:43.000957 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 603/1205] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:24:42 2022] DELETE /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:43.005269 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:43.005876 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: d395dce9-8a04-4f12-abfb-12246ee5f1d6] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:43.011716 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:43.012236 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:43.012666 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:43.013546 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:43.013788 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:43.014206 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:43.027331 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 HTTP/1.1 Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:24:43.028861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:43.030566 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': 'd395dce9-8a04-4f12-abfb-12246ee5f1d6'} Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:43.031529 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. Sep 09 21:24:43.033136 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:43.034687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance d395dce9-8a04-4f12-abfb-12246ee5f1d6 could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:43.034687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a42ed0f0-b7c3-4794-9bd3-8b1b2471d6aa tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6" status: 404 len: 111 microversion: 2.1 time: 0.028778 Sep 09 21:24:43.034687 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 603/1206] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:43 2022] GET /compute/v2.1/servers/d395dce9-8a04-4f12-abfb-12246ee5f1d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:44.306636 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:44.311500 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:44.313490 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:44.313966 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:44.314397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:44.315081 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:44.315529 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:44.315949 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:44.328876 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e HTTP/1.1 Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:24:44.330396 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.332203 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '8e1c1de6-e162-4413-8fae-d5ccbdfac60e'} Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:44.341319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.342760 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.344171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:44.344171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-749d39e8-55f1-4b18-b5a4-da83c7765b65 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 404 len: 111 microversion: 2.1 time: 0.028949 Sep 09 21:24:44.344171 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 604/1207] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:24:44 2022] DELETE /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:44.344423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:44.344423 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] [instance: 8e1c1de6-e162-4413-8fae-d5ccbdfac60e] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:24:44.348307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:44.348791 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:44.349260 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:44.349950 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:24:44.350400 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:24:44.350819 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:24:44.364573 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] HTTP exception thrown: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Request method failure captured: Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e HTTP/1.1 Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG61erZL6P11BKKOAkWSjEKJ34DeYNM8xFdGWOI3O855S6j6JPKsTB4aB_EpD7qs0sKr0pZj8pPc6S7wTh18Xbag4763ZxBMUp2sFhMQZbcXkVvRBEVtqSNbzfLCPxNGTq8-icdPAfXx_x9kE4X8Ws6F_p759p4pET3cuczYDVzb2qUM Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:24:44.368841 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1a518e979c944b3ab2a1245b3cfd246f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 1a518e979c944b3ab2a1245b3cfd246f Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1744557739 Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 56e50c46ac774417a50af986c5f87420 Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-AttachVolumeNegativeTest-1744557739-project Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: > Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.370514 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '8e1c1de6-e162-4413-8fae-d5ccbdfac60e'} Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:44.371479 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. Sep 09 21:24:44.373187 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:24:44.375056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] Returning 404 to user: Instance 8e1c1de6-e162-4413-8fae-d5ccbdfac60e could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:44.375056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b211e0f2-9b93-447d-b319-48c58d246dc8 tempest-AttachVolumeNegativeTest-1744557739 tempest-AttachVolumeNegativeTest-1744557739-project] 10.222.0.48 "GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e" status: 404 len: 111 microversion: 2.1 time: 0.031276 Sep 09 21:24:44.375056 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 604/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:24:44 2022] GET /compute/v2.1/servers/8e1c1de6-e162-4413-8fae-d5ccbdfac60e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:49.973297 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9f7758c3-694d-4345-8185-304b09089a38 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Action: 'create', calling method: .version_select at 0x7fa1d0918f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1548506608"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:24:50.616178 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9f7758c3-694d-4345-8185-304b09089a38 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.775713 Sep 09 21:24:50.616834 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 605/1209] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Sep 9 21:24:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 777 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 21:24:50.630078 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-a3c2e6d3-b8fe-4ce1-9d18-e6455e8ef81d tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0ba11f0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:50.681311 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-a3c2e6d3-b8fe-4ce1-9d18-e6455e8ef81d tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 200 len: 345 microversion: 2.1 time: 0.054951 Sep 09 21:24:50.682008 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 605/1210] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:24:50 2022] GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:51.697021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a257b0d3-3541-4bde-a242-5163819aa4a6 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d07b21f0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:51.745885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a257b0d3-3541-4bde-a242-5163819aa4a6 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 200 len: 346 microversion: 2.1 time: 0.053030 Sep 09 21:24:51.746467 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 606/1211] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:24:51 2022] GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:51.759786 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-6b8ed100-f24c-4578-b7a0-5bf403ee2337 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Action: 'create', calling method: .version_select at 0x7fa1d174cd30>, body: {"snapshot": {"volume_id": "41a234d1-749f-4836-9fbe-88c637bd247d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1014207703"}} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:24:52.204370 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-6b8ed100-f24c-4578-b7a0-5bf403ee2337 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.448726 Sep 09 21:24:52.209069 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 606/1212] 10.222.0.48 () {60 vars in 1162 bytes} [Fri Sep 9 21:24:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:52.217049 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-56a7466a-0b98-4179-9726-59f6bd91b66c tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d08079d0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:52.245754 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-56a7466a-0b98-4179-9726-59f6bd91b66c tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.033346 Sep 09 21:24:52.246313 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 607/1213] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:52 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:52.257044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d2711f26-691c-4c07-b49a-abe52fdcb685 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0db7430>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:52.288319 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d2711f26-691c-4c07-b49a-abe52fdcb685 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034860 Sep 09 21:24:52.288878 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 607/1214] 10.222.0.48 () {58 vars in 1140 bytes} [Fri Sep 9 21:24:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:52.299993 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-48607949-3cb1-4e04-b359-90b2972d875c tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d08073a0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:52.330426 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-48607949-3cb1-4e04-b359-90b2972d875c tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.034137 Sep 09 21:24:52.331014 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 608/1215] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:52 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:53.344837 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-2ee41eba-88b1-44b3-8d47-b9575ebeb59c tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0ba15e0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:53.374019 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-2ee41eba-88b1-44b3-8d47-b9575ebeb59c tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.034070 Sep 09 21:24:53.374571 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 608/1216] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:53 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:54.384354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:54.385117 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:54.388939 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a947b46d-a970-49c8-8021-51791fcd689d tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0918a60>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:54.417880 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a947b46d-a970-49c8-8021-51791fcd689d tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.034938 Sep 09 21:24:54.418433 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 609/1217] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:54 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:55.428696 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:55.429488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:24:55.435749 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-203c25a1-c9a4-4a12-8799-9be4c183ea40 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0b41700>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:55.467760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-203c25a1-c9a4-4a12-8799-9be4c183ea40 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.040389 Sep 09 21:24:55.468347 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 609/1218] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:55 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:56.481369 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-b6e77848-6591-4a4d-989c-d0e0d5244139 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d08074c0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:56.510279 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-b6e77848-6591-4a4d-989c-d0e0d5244139 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.033508 Sep 09 21:24:56.510846 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 610/1219] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:56 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:57.524725 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e6787f06-12d3-4604-a582-6ed93f1d7dfc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0d0c1f0>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:57.553969 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e6787f06-12d3-4604-a582-6ed93f1d7dfc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 288 microversion: 2.1 time: 0.034101 Sep 09 21:24:57.554523 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 610/1220] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:57 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:57.566385 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-d0e3c452-745d-4f1b-ba0a-eb7d7f289bea tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d09030d0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:57.709064 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-d0e3c452-745d-4f1b-ba0a-eb7d7f289bea tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 202 len: 0 microversion: 2.1 time: 0.147207 Sep 09 21:24:57.709653 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 611/1221] 10.222.0.48 () {58 vars in 1254 bytes} [Fri Sep 9 21:24:57 2022] DELETE /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 21:24:57.718625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-e2e9344d-3114-4d88-9bde-39dc01a4071a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d08da940>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:57.747668 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-e2e9344d-3114-4d88-9bde-39dc01a4071a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 200 len: 287 microversion: 2.1 time: 0.032970 Sep 09 21:24:57.757459 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 611/1222] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:57 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:24:58.760717 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-27139898-d70c-404c-80e1-7e3337703fee tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d08afa60>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:58.786527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-27139898-d70c-404c-80e1-7e3337703fee tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] HTTP exception thrown: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-27139898-d70c-404c-80e1-7e3337703fee tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Request method failure captured: Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 HTTP/1.1 Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG68hrxKcfISFaMNc4uz8Ca6QP1GsNGx71KjZFOAEIHUit_iBQyrM1OYOxwebGtxJ6VQUEeFnUpWrH0mnrd2cNXcWRsxL4zbzVfyluvCAPJ4vSkbreKIC6080X_rNrkFmgQUkh48tpN-g3zG59E2_cyBlW5hz_ZP_kUVPNxdpqgyoCos Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:24:58.789782 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 0646557ce9b64228a449ce5f208be980 Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '4db22463-2a29-446e-8823-0718a8881759'} Sep 09 21:24:58.791306 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. (HTTP 404) (Request-ID: req-98810747-03aa-4006-b83c-22fca8d81041) Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.792363 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:24:58.793870 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 21:24:58.795390 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-27139898-d70c-404c-80e1-7e3337703fee tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Returning 404 to user: Snapshot 4db22463-2a29-446e-8823-0718a8881759 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:24:58.797025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-27139898-d70c-404c-80e1-7e3337703fee tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759" status: 404 len: 111 microversion: 2.1 time: 0.034965 Sep 09 21:24:58.798079 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 612/1223] 10.222.0.48 () {58 vars in 1251 bytes} [Fri Sep 9 21:24:58 2022] GET /compute/v2.1/os-snapshots/4db22463-2a29-446e-8823-0718a8881759 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:24:58.800658 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-8a0252b8-42c1-430b-97be-159a179c922d tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0b49310>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:58.958441 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-8a0252b8-42c1-430b-97be-159a179c922d tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 202 len: 0 microversion: 2.1 time: 0.162283 Sep 09 21:24:58.958988 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 612/1224] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:24:58 2022] DELETE /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 21:24:58.968546 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-4deb52b0-79f6-4cc9-8027-d3d22ee42477 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0807670>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:24:59.017086 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-4deb52b0-79f6-4cc9-8027-d3d22ee42477 tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 200 len: 345 microversion: 2.1 time: 0.053560 Sep 09 21:24:59.017665 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 613/1225] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:24:58 2022] GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:25:00.033384 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-989a80e3-7f52-49e1-a9c0-b2ded6b0383a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d0d0c040>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:00.060815 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-989a80e3-7f52-49e1-a9c0-b2ded6b0383a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] HTTP exception thrown: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-989a80e3-7f52-49e1-a9c0-b2ded6b0383a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Request method failure captured: Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d HTTP/1.1 Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG68hrxKcfISFaMNc4uz8Ca6QP1GsNGx71KjZFOAEIHUit_iBQyrM1OYOxwebGtxJ6VQUEeFnUpWrH0mnrd2cNXcWRsxL4zbzVfyluvCAPJ4vSkbreKIC6080X_rNrkFmgQUkh48tpN-g3zG59E2_cyBlW5hz_ZP_kUVPNxdpqgyoCos Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:25:00.062760 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 0646557ce9b64228a449ce5f208be980 Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '41a234d1-749f-4836-9fbe-88c637bd247d'} Sep 09 21:25:00.064516 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. (HTTP 404) (Request-ID: req-0829f678-c8aa-4c0a-9ff5-2c0d0adacf85) Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.065560 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:25:00.067044 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:25:00.068635 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-989a80e3-7f52-49e1-a9c0-b2ded6b0383a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Returning 404 to user: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-989a80e3-7f52-49e1-a9c0-b2ded6b0383a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 404 len: 109 microversion: 2.1 time: 0.035073 Sep 09 21:25:00.070166 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 613/1226] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:25:00 2022] GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:25:00.078300 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a3a481f8-09db-4a22-9070-d4a04f0466cc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d089eee0>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:00.107757 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-a3a481f8-09db-4a22-9070-d4a04f0466cc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] HTTP exception thrown: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a3a481f8-09db-4a22-9070-d4a04f0466cc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Request method failure captured: Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: DELETE /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d HTTP/1.1 Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG68hrxKcfISFaMNc4uz8Ca6QP1GsNGx71KjZFOAEIHUit_iBQyrM1OYOxwebGtxJ6VQUEeFnUpWrH0mnrd2cNXcWRsxL4zbzVfyluvCAPJ4vSkbreKIC6080X_rNrkFmgQUkh48tpN-g3zG59E2_cyBlW5hz_ZP_kUVPNxdpqgyoCos Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:25:00.110032 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: 0646557ce9b64228a449ce5f208be980 Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '41a234d1-749f-4836-9fbe-88c637bd247d'} Sep 09 21:25:00.111722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. (HTTP 404) (Request-ID: req-6ab8aae5-d1e6-4021-a360-baff1444c7fe) Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.112735 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 21:25:00.114073 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 21:25:00.115395 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a3a481f8-09db-4a22-9070-d4a04f0466cc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Returning 404 to user: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a3a481f8-09db-4a22-9070-d4a04f0466cc tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 404 len: 109 microversion: 2.1 time: 0.037352 Sep 09 21:25:00.117007 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 614/1227] 10.222.0.48 () {58 vars in 1248 bytes} [Fri Sep 9 21:25:00 2022] DELETE /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:25:00.119732 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-82e0d790-f21f-4e6c-b706-a7fa7301ec9a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Calling method '.version_select at 0x7fa1d09d8f70>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:00.146588 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.wsgi [None req-82e0d790-f21f-4e6c-b706-a7fa7301ec9a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] HTTP exception thrown: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-82e0d790-f21f-4e6c-b706-a7fa7301ec9a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Request method failure captured: Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: request: GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d HTTP/1.1 Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept: application/json Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Accept-Encoding: identity Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Connection: close Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Length: 0 Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Content-Type: application/json Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Host: 10.222.0.48 Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Openstack-System-Scope: None Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: User-Agent: python-urllib3/1.26.12 Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Auth-Token: gAAAAABjG68hrxKcfISFaMNc4uz8Ca6QP1GsNGx71KjZFOAEIHUit_iBQyrM1OYOxwebGtxJ6VQUEeFnUpWrH0mnrd2cNXcWRsxL4zbzVfyluvCAPJ4vSkbreKIC6080X_rNrkFmgQUkh48tpN-g3zG59E2_cyBlW5hz_ZP_kUVPNxdpqgyoCos Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Id: None Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Domain-Name: None Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Identity-Status: Confirmed Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Is-Admin-Project: True Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Id: default Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Domain-Name: Default Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Role: reader,member Sep 09 21:25:00.148594 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Roles: reader,member Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_40066b66bdce448ea767fab6c22ce2bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Id: 40066b66bdce448ea767fab6c22ce2bc Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-378386722 Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Id: default Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Domain-Name: Default Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Id: 0646557ce9b64228a449ce5f208be980 Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: X-User-Name: tempest-VolumesSnapshotsTestJSON-378386722-project Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: method: Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: exception: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: action_args: {'id': '41a234d1-749f-4836-9fbe-88c637bd247d'} Sep 09 21:25:00.150284 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. (HTTP 404) (Request-ID: req-0d234963-a593-4c21-99b5-24ac5c0c00d1) Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.151324 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 21:25:00.152823 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 21:25:00.155155 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: ERROR nova.api.openstack.wsgi Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-82e0d790-f21f-4e6c-b706-a7fa7301ec9a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] Returning 404 to user: Volume 41a234d1-749f-4836-9fbe-88c637bd247d could not be found. {{(pid=121137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-82e0d790-f21f-4e6c-b706-a7fa7301ec9a tempest-VolumesSnapshotsTestJSON-378386722 tempest-VolumesSnapshotsTestJSON-378386722-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d" status: 404 len: 109 microversion: 2.1 time: 0.034020 Sep 09 21:25:00.156818 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 614/1228] 10.222.0.48 () {58 vars in 1245 bytes} [Fri Sep 9 21:25:00 2022] GET /compute/v2.1/os-volumes/41a234d1-749f-4836-9fbe-88c637bd247d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 21:25:54.850179 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-554420529", "imageRef": "69cf58bd-d8b2-41f5-8efc-f819a3516c50", "flavorRef": "452"}} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:25:55.088038 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.network.neutron [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] validate_networks() for None {{(pid=121136) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 21:25:55.369824 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Flavor limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 21:25:55.370247 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Image limits 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 21:25:55.370722 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Flavor pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 21:25:55.371134 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Image pref 0:0:0 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 21:25:55.371549 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.virt.hardware [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 21:25:55.380884 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.381364 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.381799 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.382527 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:55.382978 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:55.383400 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:55.399672 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Getting quotas for project ccdaeb5238614decb2020f32a52c0b20. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 21:25:55.403592 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.quota [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Getting quotas for user e1d18999210f4a7d8ef45645e7781700 and project ccdaeb5238614decb2020f32a52c0b20. Resources: {'instances', 'ram', 'cores'} {{(pid=121136) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 21:25:55.414357 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Going to run 1 instances... {{(pid=121136) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 21:25:55.416710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69cf58bd-d8b2-41f5-8efc-f819a3516c50',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 21:25:55.544963 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [53610bf4-cc9a-4e8b-b492-73d16154785b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 21:25:56.552348 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [53610bf4-cc9a-4e8b-b492-73d16154785b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54652. Sep 09 21:25:56.556601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-9ce35cce-c13c-4342-a901-9c395549ab5b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.711236 Sep 09 21:25:56.557244 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 615/1229] 10.222.0.48 () {60 vars in 1147 bytes} [Fri Sep 9 21:25:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 21:25:56.568603 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7531ffc2-c2cc-444e-bc47-a522c88b823d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:56.569223 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7531ffc2-c2cc-444e-bc47-a522c88b823d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:56.725587 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7531ffc2-c2cc-444e-bc47-a522c88b823d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:56.733079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7531ffc2-c2cc-444e-bc47-a522c88b823d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1214 microversion: 2.1 time: 0.168712 Sep 09 21:25:56.733630 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 615/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:56 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:57.756035 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:57.756667 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:57.762661 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:57.763134 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:57.763565 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:57.764277 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:57.764725 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:57.765142 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:57.828454 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:57.836601 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-2bd25fb6-0235-4117-a4a7-983723af580b tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1218 microversion: 2.1 time: 0.084917 Sep 09 21:25:57.839574 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 616/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:57 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:58.859474 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:58.860094 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:58.866543 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.867021 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.867735 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.868674 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:58.869321 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:58.869939 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:58.932861 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:25:58.941208 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-1ed5274e-7332-4042-869b-d9726630af28 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1274 microversion: 2.1 time: 0.085085 Sep 09 21:25:58.942010 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 616/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:58 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:25:59.966290 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:25:59.966967 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:25:59.974502 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:59.975025 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:59.975483 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:25:59.976267 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:25:59.976725 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:25:59.977160 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.113428 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:00.121755 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5374a870-1c98-489a-b8ca-5c8a9b748320 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.160572 Sep 09 21:26:00.122649 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 617/1233] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:25:59 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:00.851654 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-22e8e726-b074-4ac9-8f89-e89c87fa4bcb req-9b353ce0-323b-48f8-ae9e-43af13562ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6caf0b-6f5e-4961-86e4-551c96913f17", "tag": "7eb503ee-1d90-424a-82bd-11f5c8966e97"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:00.863083 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-22e8e726-b074-4ac9-8f89-e89c87fa4bcb req-9b353ce0-323b-48f8-ae9e-43af13562ef1 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:00.863857 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-22e8e726-b074-4ac9-8f89-e89c87fa4bcb req-9b353ce0-323b-48f8-ae9e-43af13562ef1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:00.866367 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-22e8e726-b074-4ac9-8f89-e89c87fa4bcb req-9b353ce0-323b-48f8-ae9e-43af13562ef1 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:00.875036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-22e8e726-b074-4ac9-8f89-e89c87fa4bcb req-9b353ce0-323b-48f8-ae9e-43af13562ef1 service nova] Creating event network-changed:7eb503ee-1d90-424a-82bd-11f5c8966e97 for instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 on hv-cinder-83124 Sep 09 21:26:00.880133 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-22e8e726-b074-4ac9-8f89-e89c87fa4bcb req-9b353ce0-323b-48f8-ae9e-43af13562ef1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Sep 09 21:26:00.880724 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 617/1234] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:26:01.144494 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:01.145145 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:01.147327 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:26:01.147475 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Fri Sep 9 21:26:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 (ip 10.222.0.48) !!! Sep 09 21:26:01.154955 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.155470 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.155910 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.156644 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:01.157096 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:01.157521 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:01.287780 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:01.295552 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-fd8dc3e5-f6f3-4d40-bd29-b98679a41485 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.154891 Sep 09 21:26:01.296228 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 618/1235] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:01 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:02.319307 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:02.319920 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:02.326006 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:02.326484 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:02.326914 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:02.327598 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:02.328051 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:02.328494 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:02.453065 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:02.460947 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-7d4a0f46-4bcf-49a9-a9a2-beec6ace7844 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.146397 Sep 09 21:26:02.461504 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 618/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:02 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:03.484568 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:03.485180 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:03.492225 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:03.492706 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:03.493139 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:03.493828 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:03.494276 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:03.494697 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:03.621710 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:03.629119 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-0e91482b-ab74-4bdb-bcd1-ccdd3ef790f9 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.148443 Sep 09 21:26:03.630259 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 619/1237] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:03 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:04.656998 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:04.657640 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:04.660488 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 21:26:04.660634 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: Fri Sep 9 21:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 (ip 10.222.0.48) !!! Sep 09 21:26:04.667937 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.668572 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.669079 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.669772 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:04.670283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:04.670746 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:04.808512 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:04.815904 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-eaa86b2b-6e3b-4319-beac-6daf27931497 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.162906 Sep 09 21:26:04.816510 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 619/1238] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:04 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:05.840093 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:05.840699 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:05.842929 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=2 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:05.843604 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG dbcounter [-] [121136] Writing DB stats nova_cell0:SELECT=6 {{(pid=121136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:05.848854 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.849333 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.849761 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.850441 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:05.850885 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:05.851303 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:05.978280 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:05.985925 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-5fe54048-a473-4f15-ad0c-2f67c0ab79c4 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.149890 Sep 09 21:26:05.986491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 620/1239] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:05 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:06.372611 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [req-2bab4497-e03f-4813-bbc9-cbfea82c506b req-e4e99bb2-cb65-4e71-ab66-6fcbbe8c3496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6caf0b-6f5e-4961-86e4-551c96913f17", "name": "network-vif-plugged", "status": "completed", "tag": "7eb503ee-1d90-424a-82bd-11f5c8966e97"}]} {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:06.382414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-2bab4497-e03f-4813-bbc9-cbfea82c506b req-e4e99bb2-cb65-4e71-ab66-6fcbbe8c3496 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:06.382826 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-2bab4497-e03f-4813-bbc9-cbfea82c506b req-e4e99bb2-cb65-4e71-ab66-6fcbbe8c3496 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:06.383248 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [req-2bab4497-e03f-4813-bbc9-cbfea82c506b req-e4e99bb2-cb65-4e71-ab66-6fcbbe8c3496 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:06.396085 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.compute.server_external_events [req-2bab4497-e03f-4813-bbc9-cbfea82c506b req-e4e99bb2-cb65-4e71-ab66-6fcbbe8c3496 service nova] Creating event network-vif-plugged:7eb503ee-1d90-424a-82bd-11f5c8966e97 for instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 on hv-cinder-83124 Sep 09 21:26:06.401623 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [req-2bab4497-e03f-4813-bbc9-cbfea82c506b req-e4e99bb2-cb65-4e71-ab66-6fcbbe8c3496 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090214 Sep 09 21:26:06.402214 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 620/1240] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:26:07.007812 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:07.008544 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:07.015022 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:07.015497 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:07.015931 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:07.016639 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:07.017085 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:07.017503 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:07.142083 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:07.150114 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-a2429971-fd0d-4782-adc0-af5a0eeb5aeb tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.146178 Sep 09 21:26:07.153375 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 621/1241] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:07 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:08.174343 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:08.175048 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:08.177625 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG dbcounter [-] [121137] Writing DB stats nova_cell0:SELECT=2 {{(pid=121137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:26:08.182979 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.187471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.187471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.187471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:08.187471 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:08.187896 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:08.331626 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:08.339524 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-d2698720-4a56-4ce9-934e-7c0a1a50b94c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1314 microversion: 2.1 time: 0.169494 Sep 09 21:26:08.340093 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 621/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:08 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:09.364455 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:09.365013 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:09.371354 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.371835 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.372329 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.373021 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.373473 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.373893 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.502491 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:09.510702 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-57e55b38-744e-4a1b-9a0f-d7eeb23c0754 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1464 microversion: 2.1 time: 0.150287 Sep 09 21:26:09.511258 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 622/1243] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:09 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:09.556036 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:09.556568 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:09.562888 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.563365 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.563804 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.564522 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.564975 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.565397 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.590143 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Going to try to terminate instance {{(pid=121137) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 21:26:09.883304 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-5218ee4f-9b08-4678-be09-d908616cc533 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 204 len: 0 microversion: 2.1 time: 0.330732 Sep 09 21:26:09.883981 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 622/1244] 10.222.0.48 () {58 vars in 1239 bytes} [Fri Sep 9 21:26:09 2022] DELETE /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 21:26:09.892257 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:09.892874 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:09.898742 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.899220 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.899656 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:09.900391 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:09.900847 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:09.901286 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:10.045998 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.policy [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121136) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:10.054309 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-86157cc0-042f-4ca7-8e02-5a6b79f38a00 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1470 microversion: 2.1 time: 0.165965 Sep 09 21:26:10.054864 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 623/1245] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:09 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:11.077759 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:11.078375 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:11.084661 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.085184 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.085600 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.086283 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:11.086733 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:11.087147 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:11.216473 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:11.224034 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-68ad67f6-ec9a-496c-b881-21d23064a74d tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1470 microversion: 2.1 time: 0.150581 Sep 09 21:26:11.224624 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 623/1246] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:11 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:11.989598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [req-9f114326-318f-4c1a-b93b-a4200c27b8a9 req-b70e8f4e-de1e-41f1-8497-6a23039d42c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6caf0b-6f5e-4961-86e4-551c96913f17", "name": "network-vif-deleted", "tag": "7eb503ee-1d90-424a-82bd-11f5c8966e97"}]} {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 21:26:12.005615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-9f114326-318f-4c1a-b93b-a4200c27b8a9 req-b70e8f4e-de1e-41f1-8497-6a23039d42c7 service nova] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:12.005615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-9f114326-318f-4c1a-b93b-a4200c27b8a9 req-b70e8f4e-de1e-41f1-8497-6a23039d42c7 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:12.005615 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [req-9f114326-318f-4c1a-b93b-a4200c27b8a9 req-b70e8f4e-de1e-41f1-8497-6a23039d42c7 service nova] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:12.014008 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.compute.server_external_events [req-9f114326-318f-4c1a-b93b-a4200c27b8a9 req-b70e8f4e-de1e-41f1-8497-6a23039d42c7 service nova] Creating event network-vif-deleted:7eb503ee-1d90-424a-82bd-11f5c8966e97 for instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 on hv-cinder-83124 Sep 09 21:26:12.019085 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [req-9f114326-318f-4c1a-b93b-a4200c27b8a9 req-b70e8f4e-de1e-41f1-8497-6a23039d42c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Sep 09 21:26:12.019771 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 624/1247] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Sep 9 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 21:26:12.246825 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.api.openstack.wsgi [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:12.247414 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.compute.api [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121137) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:12.253776 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:12.254259 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:12.254688 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:12.255918 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:12.256401 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:12.256824 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG oslo_concurrency.lockutils [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:12.318814 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: DEBUG nova.policy [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d18999210f4a7d8ef45645e7781700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdaeb5238614decb2020f32a52c0b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121137) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 21:26:12.326548 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: INFO nova.api.openstack.requestlog [None req-b1fd3007-5785-4099-a4f2-037560e7a1e2 tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 200 len: 1299 microversion: 2.1 time: 0.083684 Sep 09 21:26:12.327108 dv-cinder-831247-28-iscsi devstack@n-api.service[121137]: [pid: 121137|app: 0|req: 624/1248] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:12 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 21:26:13.353598 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Calling method '>' {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 21:26:13.354246 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.compute.api [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] [instance: 9f6caf0b-6f5e-4961-86e4-551c96913f17] Fetching instance by UUID {{(pid=121136) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 21:26:13.360359 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:13.360879 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:13.361319 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:13.362015 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Acquiring lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 21:26:13.362469 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 21:26:13.362900 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG oslo_concurrency.lockutils [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Lock "a2ceb83d-97f3-4964-9e40-c191a7de62e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 21:26:13.375902 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.wsgi [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] HTTP exception thrown: Instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 could not be found. Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Request method failure captured: Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: request: GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 HTTP/1.1 Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept: application/json Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Accept-Encoding: identity Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Connection: close Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Length: 0 Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Content-Type: application/json Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Host: 10.222.0.48 Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: Openstack-System-Scope: None Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: User-Agent: python-urllib3/1.26.12 Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Auth-Token: gAAAAABjG69gXNMduF5AzZgeqFOYHdhcl6-bwUDohvWtOWDRvQ45yZDGjS9P9SMpBgdYtA-uM7IIuDNCPtXNz1hfiyW7uH0HDhetlbWfHb2A2rv4PmkpR_MW2wrD4bmHXN-URaJHna6yL9LTRZYAbI16BZpoH_lNffaINzopQtZIMwVOPTEsYpM Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Id: None Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Domain-Name: None Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Identity-Status: Confirmed Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Is-Admin-Project: True Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Id: default Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Domain-Name: Default Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Id: ccdaeb5238614decb2020f32a52c0b20 Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Project-Name: tempest-VolumesNegativeTest-1673065498 Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Role: reader,member Sep 09 21:26:13.377528 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Roles: reader,member Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ccdaeb5238614decb2020f32a52c0b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ccdaeb5238614decb2020f32a52c0b20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ccdaeb5238614decb2020f32a52c0b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ccdaeb5238614decb2020f32a52c0b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant: tempest-VolumesNegativeTest-1673065498 Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Id: ccdaeb5238614decb2020f32a52c0b20 Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-Tenant-Name: tempest-VolumesNegativeTest-1673065498 Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User: tempest-VolumesNegativeTest-1673065498-project Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Id: default Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Domain-Name: Default Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Id: e1d18999210f4a7d8ef45645e7781700 Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: X-User-Name: tempest-VolumesNegativeTest-1673065498-project Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: method: > Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: exception: Instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 could not be found. Sep 09 21:26:13.379347 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: action_args: {'id': '9f6caf0b-6f5e-4961-86e4-551c96913f17'} Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: {{(pid=121136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 could not be found. Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 21:26:13.380397 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 could not be found. Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 could not be found. Sep 09 21:26:13.382126 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: ERROR nova.api.openstack.wsgi Sep 09 21:26:13.383642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: DEBUG nova.api.openstack.wsgi [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] Returning 404 to user: Instance 9f6caf0b-6f5e-4961-86e4-551c96913f17 could not be found. {{(pid=121136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 21:26:13.383642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: INFO nova.api.openstack.requestlog [None req-f11b5f0a-b757-4b6e-8685-581f833e037c tempest-VolumesNegativeTest-1673065498 tempest-VolumesNegativeTest-1673065498-project] 10.222.0.48 "GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17" status: 404 len: 111 microversion: 2.1 time: 0.030664 Sep 09 21:26:13.383642 dv-cinder-831247-28-iscsi devstack@n-api.service[121136]: [pid: 121136|app: 0|req: 625/1249] 10.222.0.48 () {58 vars in 1236 bytes} [Fri Sep 9 21:26:13 2022] GET /compute/v2.1/servers/9f6caf0b-6f5e-4961-86e4-551c96913f17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)